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1.0.  INTRODUCTION  AND  OVERVIEW 


1.1.  introduction 


This  is  the  final  report  for  Phase  i  of  a  program  whose  objective  is  to 
develop  a  decision-aid  for  use  at  the  U.S.  Army  Tank -Automotive  Command 
(TACOM)  in  the  allocation  of  funds  to  develop  countermeasures  for  combat 
vehicles.  The  decision-aid  being  developed  is  identified  as  SUMMET 
(Survivability  Measures  and  Methods  Evaluation  Technique) . 

SUMMET  is  being  developed  and  implemented  as  a  tool  that  will  aid  TACOM 
managers  in  deciding  which  of  many  countermeasure  alternatives  to  improve 
combat  vehicle  survival  should  be  funded  for  development.  The  SUMMET  concept 
and  its  development  to  date  are  the  subject  of  this  phase  i  final  report. 

This  report  covers  the  work  performed  by  the  Honeywell  Systems  and  Research 
Center  during  the  period  from  10  June  1982  through  30  January  1983.  This 
report  is  submitted  in  accordance  with  Data  Item  A002  of  contract  No. 
DAAE07-82-C-4049.  SUMMET  is  being  developed  for  the  Survivability  Research 
Division  of  the  Tank-Automotive  Concepts  Laboratory,  U.S.  Army  Tank-Automotive 
Command,  with  Dr.  James  L.  Thompson,  Head  of  the  Survival  Technology  Function, 
as  the  Technical  Representative. 

Raymond  W.  Schaefer  is  the  Honeywell  Program  Manager  for  SUMMET.  Dr.  Jan  D. 
Wald  is  the  principal  investigator  and  work  director.  The  other  principal 
contributors  to  the  SUMMET  development  are  Peter  L.  Gilles,  James  A. 

Hawthorne,  Dennis  J.  Adsit,  and  Jeffrey  P.  Schwartz. 

Additional  reference  material  is  contained  in  Honeywell  Report  no.  F2276-1, 
dated  5  August  1982  and  entitled,  "Methodology  Base  Evaluation  of  Decision 
Support  Systems."  That  report  covers  the  front-end  phase  i  work  to  first 
review  decision-theoretic,  expert-system,  and  planning-system  decision-aid 
methods  and  then  evaluate  their  applicability  for  SUMMET.  The  report 
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identifies  "pieces"  of  existing  or  proposed  methods  that  are  attractive  for 
incorporation  in  the  decision-aid  desired  by  TACOM. 

With  completion  of  Phase  I,  SUMMET  development  has  progressed  to  a  point  where 
the  decision-aid  concept  is  available  to  try,  test,  and  evaluate.  The  concept 
is  detailed  in  Section  2.0  of  this  report.  Computerized  aids  are  available  to 
support  the  trying,  testing,  and  evaluation  of  the  SUMMET  concept.  These 
computerized  aids  are  explained  in  Section  3.0.  More  decision  makers  in  the 
countermeasure  arena,  both  in  and  out  of  TACOM,  have  been  identified  to 
participate  in  finalizing  SUMMET  and  its  user  interface.  The  issues  of  user 
interface  are  addressed  in  Section  4.0.  Participation  by  managers  who  will 
use  SUMMET  and  by  managers  with  whom  they  interact  on  countermeasure  decisions 
continues  as  mandatory  to  develop  a  decision-aid  that  is  understandable, 
usable,  and  acceptable. 

To  best  benefit  the  users  of  the  SUMMET  decision-aid  these  features  are  being 
incorporated : 

o  it  will  dissect  the  "which  countermeasures  to  fund"  decision  problem 
into  a  manageable  number  of  meaningful  "decision-dimensions."  At 
this  point,  the  decision-dimensions  in  SUMMET  are  r&d  time,  r&d  risk, 
R&D  cost,  performance  effectiveness,  combat  utility,  and  user 
acceptance.  These  decision-dimensions  are  defined  in  Section  2.0. 

o  It  will  allow  a  utility  or  worth-of -development  evaluation  of 

proposed  countermeasure  projects  in  each  of  the  decision-dimensions, 
and  allow  utility  to  be  measured  in  terms  that  are  familiar  to  and 
used  by  the  R&D  decision  maker.  "High,"  "medium,"  and  "low"  are  the 
measurement  terms  for  utility  that  are  used  in  SUMMET. 
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It  will  interpret  the  set  of  utility  evaluations  for  each  proposed 
development  approach  to  each  proposed  countermeasure  to  yield 
"preferred  for  funding"  indicators  and  perform  the  interpretation  in 
a  manner  that  is  consistent  with  the  decision  process  of  the  R&D 
decision  maker.  At  this  point,  the  preference  indicators  in  SUMMET 
are  "go/no-go,"  go-likelihood,  and  cost-benefit. 

o  It  will  require  input  that  is  reasonable  in  terms  of  what  the 

decision  maker  can  generate  and  what  is  or  can  be  made  available  to 
him,  and  accommodate  and  reflect  uncertainty  and  variability  of 
input.  Candidate  inputs  are  described  and  exemplified  in  Sections 
2.0,  3.0,  and  4.0. 

o  It  will  be  easy  to  use  and  audit  and  be  consistent  with  the  objective 
to  "keep  it  simple,  but  not  trivial."  It  must  also  be  easy  to 
modify,  permit  sensitivity  analysis,  be  paper  and  pencil  testable, 
and  be  amenable  to  computerization.  These  features  underlie  the 
basic  structure  of  SUMMET. 

These  goal  features  of  SUMMET  give  some  clue  as  to  how  SUMMET  will  operate. 

Let's  look  at  its  envisioned  operation  a  little  more  closely. 

1.2.  Summet  Overview 


Figure  1-1  highlights  what  might  be  termed  the  concept  of  operation  for  the 
decision-aid  called  SUMMET.  With  reference  to  the  figure,  the  concept  is  as 
follows.  The  R&D  decision  maker  is  presented  with  proposals  for  the 
development  of  countermeasures  (CMs) ,  intended  to  improve  the  survivability  of 
combat  vehicles.  These  proposals  will  address  not  only  different  CMs,  but 
alternative  ways  to  approach  their  development  as  well.  (For  example:  a  low 
cost,  high  risk  approach;  a  high  cost,  longer  time,  low  risk  approach;  a  low 
cost,  low  risk,  lower  capability  approach,  and  so  on.)  The  CM  proposals  will 
vary  in  information  that  defines  the  character  of  the  CM,  and  of  its  one  or 
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Figure  1-1.  SUMMET  Concept  of  Operation 


more  development  approaches,  in  each  of  the  "decision-dimensions"  of 
interest,  as  noted  earlier,  R&D  time,  R&D  risk,  R&D  cost,  performance 
effectiveness,  combat  utility,  and  user  acceptance  are  examples  of 
decision-dimensions.  One  proposal  may  include  substantiated  and  quantitative 
characteristics  in  all  decision-dimensions;  another  in  just  some  dimensions; 
another  proposal  may  include  only  best  estimate  value  ranges,  because  the  CM 
concept  has  only  just  surfaced.  Nevertheless,  the  decision  maker  wants  to 
consider  all  proposals  and  knows  that  there  will  never  be  enough  time  or 
enough  money  to  get  all  of  the  proposals  to  provide  all  of  the  desired 
characteristics  to  all  the  same  level.  He  will  use  the  characteristics  of 
time,  risk,  effectiveness  and  so  on,  as  provided.  He  will  generate  or  will 
cause  to  be  generated  the  missing  data  to  the  level  of  specificity  and 
certainty  possible.  This  results  in  a  set  of  "input  for  SUMMET" 
characteristic  data  for  each  proposed  CM/development  approach  combination. 

Note  that  if  there  are  four  different  approaches  to  one  CM  (i.e.,  four 
different  combinations  of  risk,  time,  effectiveness,  acceptance,  and  so  on), 
SUMMET  will  be  used  to  examine  four  proposals  and  not  one.  in  this  manner, 
SUMMET  will  aid  the  decision  on  both  preferred  CMs  and  development  approaches. 

With  CM  and  development  characteristics  in  hand  for  each  proposed  CM  and 
development  approach  combination,  the  R&D  decision  maker  is  ready  to  use 
SUMMET.  He  can  input  one  combination  at  a  time  and  perform  sensitivity  tests 
which  may  in  turn  flag  the  need  to  "firm  up"  certain  "first  guess" 
uncertainties.  He  may  first  want  a  "batch"  examination  of  all  proposed  CMs 
and  development  approaches  to  aid  a  "first  sort"  elimination  of  less 
attractive  proposals.  The  decision  maker  may  want  to  use  SUMMET  in  a  number 
of  different  ways.  More  of  the  envisioned  use  options  are  described  in 
Section  4.0. 

As  indicated  in  Figure  1-1,  a  CM  and  its  development  characteristics  in  each 
decision-dimension  are  input  to  what  are  called  the  SUMMET  "utility 
functions."  What  is  a  utility  function?  in  SUMMET,  if  may  be  thought  of  as 
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something  that  assigns  a  "high,"  "medium,"  or  "low"  worth  to  particular  values 
in  each  decision-dimension.  For  example,  let's  look  at  the  decision-dimension 
of  R&D  cost.  The  utility  function  for  R&D  cost  may  say  the  following:  If  a 
proposed  CM  R&D  cost  is  projected  to  be  less  than  5  percent  of  the  total 
available  budget  for  CM  developments,  then  the  worth  or  utility  of  that 
proposed  CM  development  project  is  high  in  the  R&D  cost  dimension;  if  the 
projected  R&D  cost  is  greater  than  10  percent  of  the  total  budget,  then  the 
worth  or  utility  in  this  cost  dimension  is  low;  otherwise  the  worth  or  utility 
in  this  cost  dimension  is  medium.  Examples  of  utility  functions  are  presented 
in  Section  2.0  for  each  of  the  six  dimensions  of  R&D  time,  R&D  risk,  R&D  cost, 
performance  effectiveness,  combat  utility,  and  user  acceptance.  The  point  to 
be  made  here  is  that  the  first  step  in  the  exercise  of  SUMMET  is  an  assessment 
of  the  utilities  or  the  worth  of  each  proposed  CM  development.  The  assessment 
output  for  each  proposed  CM  development  is,  in  general,  a  set  of  probabilities 
that  the  CM  development  is  of  high,  medium,  or  low  utility  in  each 
decision-dimension.  Table  1-1  exemplifies  this  development  utility  output. 

In  SUMMET  this  development  utility  output  is  next  input  to  what  are  called 
"decision  heuristics."  Before  discussing  this  next  step  another  point  should 
be  made.  When  fully  implemented,  SUMMET  will  allow  for  easy  modification  of 
what  and  how  many  decision-dimensions  are  to  be  considered,  similarly,  easy 
modification  of  utility  functions  will  be  provided  for.  Now,  on  to  the  next 
step  in  SUMMET. 

The  next  step  in  SUMMET  is  the  preferential  ordering  of  proposed  CM 
developments.  This  is  accomplished  through  exercise  of  what  are  called 
decision-heuristics.  What  is  a  decision-heuristic?  it  is  one  of  a  set  of 
rules  that,  when  satisfied  by  a  proposed  CM  development,  indicates  development 
acceptability,  it  is  one  of  a  set  of  rules  that  is  created  by  decision  makers 
as  part  of  SUMMET  implementation  and  becomes  an  integral  part  of  the  SUMMET 
decision-aid.  Details  of  these  heuristic  rules  are  presented  in  Section  2.0. 
Figure  1-2  exemplifies  one  of  the  set  of  these  go  decision  rules  that  has 
already  been  formulated  from  preliminary  interviews  with  TACOM  decision  makers. 
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TABLE  1-1.  UTILITIES  OP  DEVELOPMENT — AN  EXAMPLE 


CM:  Threat  warning/reaction  system 
Development  Approach:  Low  cost,  high  risk 
Utilities  of  development  determined  with  SUMMET: 


UTILITY  LIKELIHOOD  FOR: 

utility 

LEVEL 

R&D 

TIME 

R&D 

RISK 

R&D 

COST 

PERFORMANCE 

EFFECTIVENESS 

COMBAT 

UTILITY 

USER 

ACCEPTANCE 

HIGH 

0.0 

0.11 

0.7 

0.3 

0.8 

MEDIUM 

0.75 

0.23 

0.3 

0.5 

0.2 

LOW 

0.25 

D 

0.66 

0.0 

0.2 

0.0 

1  2  3  4  5  6 


RULE  NO.  46 


M+,  H,  L,  M,  M-,  H 


THIS  RULE  SAYS  THAT  IF, 

1.  DEVELOPMENT-TIME  UTILITY  IS  MEDIUM  OR  HIGH  AND, 

2.  DEVELOPMENT-RISK  UTILITY  IS  HIGH  (I.E.,  RISK  IS  LOW)  AND, 

3.  DEVELOPMENT-COST  UTILITY  IS  LOW  (I.E.,  COST  IS  HIGH)  AND, 

4.  PERFORMANCE-EFFECTIVENESS  UTILITY  IS  MEDIUM  AND, 

5.  COMBAT-UTILITY  IS  MEDIUM  OR  LOW  AND, 

6.  USER-ACCEPTANCE  UTILITY  IS  HIGH, 

THEN,  A  PROPOSED  CM  DEVELOPMENT  PROJECT  IS  ACCEPTABLE  FOR 
R&D  FUNDING. 


Figure  1-2.  An  Example  of  an  Heuristic  "Go"  Decision  Rule 
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In  SUMMET,  the  utilities  of  development,  as  discussed  earlier  and  as 
exemplified  in  Table  1-1,  are  interacted  with  all  of  the  go  heuristic  decision 
rules.  This  yields  a  likelihood  (where  0  £  likelihood  £  1)  that  each 
proposal  CM  is  acceptable  for  develoment.  once  this  step  is  completed  for  all 
proposed  CM  developments,  a  number  of  preference  rankings  of  the  proposed 
developments  can  be  provided  from  SUMMET.  One  ranking  would  be  on  the  basis 
of  go  likelihood.  Another  ranking  would  be  on  the  basis  of  go  likelihood  and 
cost-benefit  (a  cost-benefit  ranking  algorithm  is  presented  in  Section  2.0). 
Still  another  ranking  would  be  on  the  basis  of  go  likelihood  and  ranked 
decision  rules  (this  particular  ranking  possibility  remains  under 
investigation).  For  each  of  these  preference  rankings,  SUMMET  then  provides 
the  decision  maker  with  sets  of  preferred  CM  developments,  each  set  chosen  on 
a  different  basis.  For  example,  one  set  of  preferred  cm  developments  would  be 
on  the  basis  of  all  top-ranked  developments  within  the  R&D  budget.  Another 
set  of  preferred  developments  would  be  the  maximum  number  of  ranked 
developments  within  the  R&D  budget.  The  key  point  is  that  SUMMET  will  provide 
the  decision  makers  with  rankings  and  preferences  made  on  a  number  of 
different  bases.  He  then  makes  the  final  choice.  Remember,  SUMMET  is  a 
decision-aid  and  not  a  decision-maker. 

With  this  as  an  overview  of  the  concept  of  operation  for  the  SUMMET 
decision-aid,  let  us  now  proceed  with  further  concept  detail  (Section  2.0) , 
with  explanation  of  the  computer  aids  developed  to  date  (Section  3.0) ,  and 
with  discussion  of  SUMMET  user  interface  issues  (Section  4.0). 

2.0.  THE  SUMMET  CONCEPT 

In  the  previous  section  we  overviewed  the  concept  of  operation  for  the 
decision-aid  called  SUMMET.  The  purpose  of  this  section  is  to  delve  deeper 
into  the  constructs  of  SUMMET  and  explain  them  in  more  detail,  to  preamble 
the  discussion,  and  because  SUMMET  involves  some  new  "wrinkles"  in  the  world 
of  decision-aids,  let  us  once  more  quickly  walk  through  the  SUMMET  concept  (we 
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say  concept  because  SUMMET  is  not  fully  developed  and  implemented  at  this 
point  in  time;  its  design  details  are  not  yet  frozen,  but  its  overall 
philosophy  and  structure  are) .  To  aid  the  walk  through  we  will  follow  the 
flow  depicted  in  Figure  2-1. 

As  indicated  in  Figure  2-1,  the  SUMMET  exercise  process  starts  with  decision 
maker  input  that  characterizes  one  or  more  proposed  CM  developments  in  each  of 
six  decision-dimensions:  R&D  time,  R&D  risk,  R&D  cost,  performance 
effectiveness,  combat  utility,  and  user  acceptance  (where  user  is  the  military 
user  of  the  CM  to  be  developed) .  These  input  data  may  be  discrete  values  or 
distributions  of  values  or  mixes  of  both  types.  These  input  data  are  operated 
on  by  utility  functions  (built  into  SUMMET)  to  asssess  in  each  decision- 
dimension  whether  the  utility  of  development  is  high,  medium,  low,  or  some 
likely  combination  of  high,  medium,  and  low  (recall  that  Table  1-1  exemplified 
this  utility  assessment  step).  These  high,  medium,  low,  and  likelihood 
measures  of  utility  are  then  input  to  and  operated  on  by  heuristic  decision 
rules  (also  built  into  SUMMET) .  This  step  yields  measures  of  the 
acceptability  of  the  proposed  CM  development.  Ranking  algorithms,  and  perhaps 
additional  heuristic  rules,  are  then  exercised  within  SUMMET  to  provide  one  or 
more  orderings  of  all  the  CM  proposals  considered.  Now,  before  we  proceed 
with  details,  one  point  needs  to  be  emphasized:  while  utility  functions  and 
decision-heuristics  will  be  built  into  SUMMET,  provisions  will  be  made  to 
allow  changes  to  these  functions  and  heuristics.  Such  changes  will  not  be 
made  by  just  anyone,  but  only  by  the  person  or  persons  who  are  the  decision 
makers  and  who  want  the  decision-aid  to  reflect  their  philosophy  of  utility 
and  acceptability  of  development. 

In  the  further  explanation  of  the  SUMMET  concept,  we  will  first  deal  with 
heuristics,  what  they  are,  how  they  are  derived,  where  they  stand  at  this 
point  in  time,  and  what  more  needs  to  be  done. 


RANK  VALUES  FOR  THE  — 
CM  OEVELOFMENT  PROJECTS 


ELOJPME 

0 


1 


Figure  2-1.  SUMMET  Information  Flow 
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2.1.  Decision  Heuristics 


2.1.1.  Definition  and  Status.  SUMMET  decision  heuristics  are  sextuple  rules 
of  the  form  shown  in  Figure  1-2.  They  are  termed  go  rules,  because  they  cover 
the  total  "acceptable  development -utility  space."  They  are  independent  rules 
since  the  acceptable  utility  space  covered  by  any  one  rule  does  not  overlap 
the  space  covered  by  any  other  of  the  rules.  A  working  set  of  go  decision 
rules  is  given  in  Figure  2-2,  where  the  convention  for  stating  a  rule  is  also 
defined.  We  use  the  term  "working  set"  because  this  particular  set  of  rules 
was  derived  from  intentionally  exploratory  and  not  sufficiently  complete 
interview  sessions  with  TACOM  decision  makers.  (SUMMET  development  did  not 
start  with  the  premise  of  incorporating  heuristic  decision  rules;  rather,  the 
desirability  of  using  heuristics  evolved  from  the  TACOM  manager  interview 
process.)  A  structured  interview  process  will  be  used  in  phase  II  to  finalize 
the  go  decision  rule  set.  it  is  of  value  here  to  review  the  process  of 
working  set  rule  development  and  to  describe  the  computer  aids  now  available 
to  enhance  the  rule  development  process. 

The  working  set  of  decision  rules  or  heuristics  given  in  Figure  2-2  is  based 
on  interviews  with  four  manager-level  individuals;  three  within  and  one 
formerly  with  the  Tank-Automotive  Concepts  Laboratory  of  TACOM.  Each  of  these 
interviewees  was  presented  with  preselected  sextuples  of  utility  hypothesized 
to  represent  the  utilities  of  development  determined  for  each  of  some  18 
different  and  unnamed  CM  development  proposals,  to  each  of  these  18  different 
sextuples,  each  interviewee  was  asked  to  respond  with  either  a  "yes,  I  would 
fund  that  proposal,"  or  with  a  "no,  i  would  not  fund  that  proposal."  (We 
should  note  that  each  of  these  managers  dealt  easily  and  quickly  with  these 
sextuple  data  sets  of  different  high,  medium,  and  low  combinations.)  Each 
interviewee  also  commented  on  the  reasons  for  his  particular  responses.  To 
illustrate  the  questions  posed  to  the  interviewees,  one  of  the  presented 
sextuples  was:  "If  development  time  utility  was  high,  and  if  development  risk 
utility  was  medium,  and  if  development  cost  utility  was  high,  and  if 
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Figure  2-2.  "Go"  Decision  Rules — a  Working  Set 


performance  effectiveness  utility  was  low,  and  if  combat  effectiveness  utility 
was  low,  and  if  user  acceptance  utility  was  high,  would  you  fund  such  a  CM 
proposal?"  Before  posing  such  a  question,  the  interviewer  and  the  interviewee 
discussed  the  meaning  and  the  interpretation  of  high,  medium,  and  low  utility 
in  each  of  the  decision-dimensions  of  time,  risk,  cost,  performance 
effectiveness,  combat  utility,  and  user  acceptance  (from  these  discussions, 
candidate  definitions  of  utility  functions  evolved;  these  will  be  described 
shortly) .  The  four  interviewees  agreed  on  those  sextuples  which  were  heavily 
weighted  with  highs  or  lows;  they  varied  on  more  evenly  weighted  sextuples, 
which  is  to  be  expected  since  the  moderately  weighted  sextuples  are  more 
debatable  as  to  acceptability  for  funding.  Later  in  this  discussion  we  will 
talk  about  how  differences  in  the  go/no-go  space  among  decision  makers  may  be 
accommodated  in  SUMMET. 

The  18  test  sextuples  used  in  the  exploratory  interviews  were  not  sufficient, 
of  course,  to  completely  determine  the  go/no-go  acceptability  for  each  of  the 
729  (36)  possible  combinations  of  high,  medium,  or  low  in  each  of  six 
dimensions.  We  derived  the  final  working  set  of  decision  heuristics  in 
Figure  2-2  by  extrapolating  primarily  from  the  decision  responses  made  by  the 
individual  that  had  the  highest  decision-making  authority.  Two  significant 
accomplishments  were  achieved  in  the  derivation  of  this  working  set  of 
decision  rules.  The  first  was  to  demonstrate  that  such  decision  rules  are 
indeed  derivable.  The  second  is  that  computer-aided  techniques,  developed 
during  the  preliminary  rule  derivation  process,  are  now  in  place  to 
selectively,  and  thereby  rapidly,  take  a  decision  maker  through  the  entire 
decision  space  and  derive  his  set  of  decision  rules.  Let's  briefly  describe 
these  rule  derivation  computer  aids. 

Figures  2-3  through  2-5  are  "screens"  generated  from  a  "Heuristics  Acquisition 
Program"  we  have  written  in  BASIC  to  run  on  an  Apple  II  computer.  This 
interactive  program  aids  the  efficient  acquisition  of  go  decision  rules.  It 
takes  advantage  of  the  fact  that,  in  general,  when  any  sextuple  of  utilities 
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DEVELOPMENT  TIME  UTILITY  IS 
DEVELOPMENT  RISK  UTILITY  IS 
DEVELOPMENT  COST  UTILITY  IS 
PERFORMANCE  EFF.  UTILITY  IS 
COMBAT  UTILITY  UTILITY  IS 
USER  ACCEPTANCE  UTILITY  IS 


M 

M 

M 

M 

M 

M 


THIS  RULE  IS: 


A)  60  RULE 

B)  GO  RULE  AND  UPPER  LIMIT  TO  NOGO’S 

C)  NOGO  RULE 

D)  NOGO  RULE  AND  LOWER  LIMIT  TO  GO’S 
WHICH7C 


NEW 

GO’S 

0 

NEW  NOGO’S 

64 

TOTAL 

GO’S 

TOTAL  NOGO 

UNDECIDED 

0 

64 

665 

PRESS 

ESC  TO 

SAVE  CURRENT 

RULES  &  QUIT 

PRESS 

RETURN 

TO  CONTINUE 

Figure  2-4.  First  Question/Answer  Screen  in  the  Heuristics  Acquisition  program 


DEVELOPMENT  TIME  UTILITY  IS  H 
DEVELOPMENT  RISK  UTILITY  IS  H 
DEVELOPMENT  COST  UTILITY  IS  H 
PERFORMANCE  EFF.  UTILITY  IS  L 
COMBAT  UTILITY  UTILITY  IS  M 
USER  ACCEPTANCE  UTILITY  IS  M 

THIS  RULE  IS: 


A)  GO  RULE 

B)  GO  RULE  AND  UPPER  LIMIT  TO  NOGO’S 

C)  NOGO  RULE 

D)  NOGO  RULE  AND  LOWER  LIMIT  TO  GO’S 
WHICHTA 


NEW 

GO’S 

NEW  NOGO’S 

4 

0 

TOTAL 

GO’S 

TOTAL  NOGO 

UNDECIDED 

44 

120 

565 

PRESS 

ESC  TO 

SAVE  CURRENT 

RULES  &  QUIT 

PRESS 

RETURN 

TO  CONTINUE 

Figure  2-5.  Nth  Question/Answer  Screen  in  the  Heuristics  Acquisition  program 


is  decided  as  a  go  or  a  no-go/  such  decision  automatically  decides  many  other 
sextuples  to  also  be  go  or  no-go.  For  example,  in  the  convention  of 
Figure  2-2,  if  a  decision  maker  says  that  the  utility  combination  of  (H,  M,  H, 
L,  L,  H)  is  a  go,  he  has  by  this  one  decision  identified  not  just  one,  but 
Ix2xlx3x3xl,  or  18  combinations,  as  goes.  This  is  because  if  the  utility 
combination  (H,  H,  H,  L,  L,  H)  is  a  go,  then  each  utility  combination  in  the 
set  (H,  M+,  H,  L+,  L+,  H)  is  also  a  go.  This  "decision-on-one  means  a 
decision-on-many"  principle  is  used  in  the  Heuristics  Acquisition  program 
illustrated  by  Figures  2-3  through  2-5. 

Figure  2-3  illustrates  the  preparatory  steps  in  the  interactive  Heuristics 
Program.  Figure  2-4  is  the  question-starter  screen  that  asks  whether  the 
utility  combination  (M,  M,  M,  M,  M,  M)  is:  (a)  a  go  rule;  (b)  a  go  rule  and 
an  upper  bound  to  no-goes;  i.e.,  all  combinations  with  lesser  utility  values 
in  each  dimension  are  no-goes;  (c)  a  no-go  rule;  or  (d)  a  no-go  rule  and  a 
lower  bound  to  goes,  i.e.,  all  combinations  with  higher  utility  values  in  each 
dimension  are  goes,  in  the  example  of  Figure  2-3,  (M,  M,  M,  M,  M,  M)  is 

decided  as  a  no-go  rule  and  when  such  decision  is  input,  the  program 

identifies  that  this  decision  really  decided  2x2x2x2x2x2,  or  64  utility 
combinations  to  be  no-goes.  The  program  further  identifies  that  729  minus  64 
(or  665)  utility  combinations  remain  to  be  decided  on.  The  program  then 
advances  to  another  undecided  rule,  a  question  is  asked,  a  decision  is  input, 
and  the  number  of  undecided  cases  are  updated.  Figure  2-5  is  an  illustration 

of  screens  presented  in  the  middle  of  the  question  and  answer  process,  a 

process  which  continues  until  all  combinations  are  decided.  The  program  then 
prints  out  utility  combinations  that  cover  the  total  go  space.  These 
combinations  are  not  necessarily  non-overlapping  or  independent,  since 
non-overlapping  or  independent  rules  are  required  for  "likelihood  of  go" 
determinations  in  SUMMET,  we  have  developed  another  Apple  n,  BASIC  language 
program  that  aids  the  derivation  of  independent  go  decision  rules,  such  as  are 
given  in  Figure  2-2. 
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2.1.2.  Future  Directions.  There  are  two  issues. that  future  refinements  in 
the  SUMMET  decision  heuristics  should  address: 

o  Ordering  the  decision  space  as  one  means  to  aid  the  ranking  of  CM 
development  proposals. 

o  Resolving  or  accommodating  different  or  conflicting  expert  opinion. 

The  present  approach  to  SUMMET  decision  heuristics  does  not  distinguish  among 
goes  of  varying  desirability,  intuitively  a  CM  proposal  utility  corresponding 
to  a  sextuple  like  (H,  H,  H,  H,  Hf  H)  is  much  more  desirable  than  a  proposal 
corresponding  to  a  go  sextuple  near  the  go/no-go  border,  e.g.,  (M,  M,  M,  H, 

L,  L) .  The  present  system  does  not  make  such  distinctions.  All  goes  are  on  a 
par,  and  all  no  goes  are  on  a  par. 

One  approach  to  ordering  the  goes  is  to  determine  weights  representing  the 
relative  importance  of  each  of  the  six  decision-dimensions.  This  approach  has 
the  drawback  that  expert  decision  makers  may  not  have  clear  intuitions  about 
precise  weights.  Ordering  of  the  decision  space  will  be  studied  in  the  next 
phase  of  SUMMET  development.  Other  techniques  to  aid  rank  ordering  of 
proposed  CM  developments  will  also  be  investigated.  An  example  of  a  cost 
benefit  ranking  measure  will  be  described  later  in  our  discussion  of  utility 
functions. 

With  regard  to  the  issues  of  how  to  resolve  differences  in  expert  opinion  and 
how  to  reconcile  the  resulting  different  set  of  heuristics,  two  approaches 
come  to  mind. 

The  first  approach  involves  developing  a  compromise  set  of  heuristics.  Most 
sextuples  won't  be  in  dispute  among  decision  makers;  they  will  be  clear  goes 
or  clear  no-goes.  Disagreements  will  generally  occur  on  sextuples  near  the 
go/no-go  borderline.  The  first  approach  would  get  decision  makers  to  work  out 
their  borderline  differences. 
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The  second  approach  would  involve  taking  advantage  of  the  differences  rather 
than  trying  to  resolve  them.  One  could,  for  example,  derive  a  different  set 
of  heuristics  for  each  of  n  decision  makers.  The  SUMMET  system  would  evaluate 
the  go  probability  of  a  CM  proposal  relative  to  each  decision  maker's  set  of 
heuristics.  This  simply  involves  running  the  same  output  from  the  lower  level 
SUMMET  evaluation  through  each  of  the  n  heuristic  sets.  An  average  go 
probability  for  the  CM  proposal  could  then  be  calculated  by  summing  the 
resulting  n  go  probabilities  and  dividing  by  n.  This  technique  gives  each 
heuristic  set  an  equal  vote.  Extra  votes  could  be  given  to  heuristic  sets 
derived  from  more  authoritative  decision  makers  by  weighting  their  go 
decisions  more  heavily.  This  difference  of  opinion  among  decision  makers  will 
be  addressed  further  in  the  next  phase  of  SUMMET  development. 

Having  now  defined  and  described  decision  heuristics  and  their  status,  let  us 
turn  our  attention  to  SUMMET  utility  functions  and  input  data. 

2.2.  Utility  Functions  and  input 

Our  discussion  will  now  deal  with  utility  functions,  what  they  are  in  SUMMET, 
and  what  "trial"  definitions  for  these  functions  are  now  in  place. 

Utility  functions  in  SUMMET  are,  as  noted  earlier,  assessors  of  the  worth  of 
CM  development  in  each  of  the  decision-dimensions  of  time,  risk,  cost,  and  so 
on.  This  assessor  role  was  depicted  in  Figure  2-1.  The  utility  functions 
operate  on  the  decision  maker's  input  data,  which  characterizes  each  proposed 
CM  and  each  of  its  proposed  development  approaches.  The  utility  functions 
then  output  whether  the  utility  or  worth  of  development  in  each  decision- 
dimension  is  low,  medium,  high,  or  some  likely  combination  of  these  levels. 

The  notion  to  use  high,  medium,  and  low  measures  of  utility  stemmed  from  our 
exploratory  interviews  with  TACOM  and  other  decision  makers,  we  found  the 
high,  medium,  and  low  descriptors  to  be  convenient,  manageable,  and  often 
used.  Recall  such  phrases  as:  "I'd  fund  that  project  if  the  risk  were 
lower , "  or  "I'd  accept  less  than  high  effectiveness  if  the  cost  were 
moderate. " 
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With  this  brief  introduction,  let  us  now  describe  the  "trial"  utility 
functions  that  are  currently  "in  place"  in  SUMMET.  We  say  trial  because  they 
need  to  be  examined  for  acceptability  by  TACOM  decision  makers.  We  say  in 
place  because  they  are  incorporated  in  the  SUMMET  I  computer  program  described 
in  Section  3.0. 

2.2.1.  R&D  Time  and  utility.  Let  R&D  time,  T,  (sometimes  called  development 
time)  be  the  time  from  initiation  of  CM  research  and  development  to  the  time 
when  both  feasibility  has  been  demonstrated  and  engineerability  has  been 
proven  within  accepted  standards.  Let  R&D  time  utility,  U(T),  be  then  defined 
as  follows: 

T 

(Years)  U(T) 

<2  High 

>2  but  <4  Medium 

>4  Low 

R&D  time,  T,  is  one  of  the  characteristics  of  a  CM  development  project  that 
the  decision  maker  must  input  to  SUMMET.  As  with  any  SUMMET  input,  T  may  be 
input  as  a  discrete  value,  as  a  Beta  distribution,  or  as  a  histogram  of  values 
(this  latter  form  allows  for  a  uniform  distribution  of  values) .  These  input 
options  are  described  further  in  Section  3.0.  SUMMET  will  allow  these 
different  forms  of  input  in  order  to  best  reflect  real  uncertainty  or  real 
variability  that  may  exist  in  the  characteristics  of  a  proposed  CM  and  a 
proposed  development  approach. 

2.2.2.  R&D  Risk  and  Utility.  Let  R&D  risk,  R,  (sometimes  called  development 
risk)  be  the  estimated  probability  that  a  propoed  approach  for  a  CM 
development  program  will  not  achieve  a  technical  development  result  at  least 
as  good  as  the  intended  result.  Let  R&D  risk  utility,  U(R),  then  be  defined 
as  follows: 


R 

<0.25 

>0.25  but  <0.5 
>0.5 

The  development  risk,  R,  may  be  input  as  a  discrete  value  or  as  some 
distribution  of  values.  The  notion  to  input  a  distribution  of  risk  values 
stems  from  the  thought  that  a  decision  maker  may  query  a  team  of  his  experts 
and  ask  each  expert  to  estimate  the  probability  that  a  proposed  cm  development 
will  not  achieve  its  proposed  technical  objective.  The  decision  maker  may 
then  wish  to  input  the  distribution  of  responses  from  the  team,  rather  than 
some  average  response. 

2.2.3.  R&D  Cost  and  Utility.  Let  the  R&D  cost  (sometimes  called  development 
cost)  of  a  proposed  CM  development  be  measured  in  "fraction  of  budget"  terms, 
rather  than  in  absolute  dollar  terms.  Specifically,  let  the  R&D  cost  metric, 
9,  for  a  proposed  CM  development  be  the  ratio  $^$13  where: 

$_  is  the  total  R&D  dollar  cost  projected  for  a  proposed  CM  development 
over  the  most  likely  total  time  projected  for  its  development  (this  most 
likely  time  is  thus  the  most  likely  value  for  the  R&D  time  characteristic, 
T,  defined  earlier) ;  and  is  the  total  dollar  budget  projected  to  be 
available  for  all  CM  developments  during  this  same  most  likely  development 
time.  Let  R&D  cost  utility,  U(9),  be  then  defined  as: 

9 

Fraction  of  Budget 
<0.05 

>0.05  but  <0.10 

>0.10 
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Again,  as  with  all  other  input  characteristics,  the  R&D  cost  metric,  $,  may  be 
input  as  a  discrete  or  as  a  distribution  of  values. 

2.2.4.  Performance  Effectiveness  and  Utility.  Let  performance  effectiveness 
of  a  CM  proposed  for  development  be  characterized  by  the  increase  in 
survivability  that  the  CM  affords  to  a  vehicle  against  each  threat  system  or 
systems  that  the  CM  is  intended  to  counter.  Specifically,  let  "increase  in 
probability  of  survival"  be  the  characteristic  parameter  to  describe  CM 
performance  effectiveness,  E.  Let  the  performance  effectiveness  utility, 

U (E) ,  be  defined  as: 


E 

Increase  in  Probability 


of  Survival _  u  (E) 

<0.2  Low 

>0.2  but  <0.4  Medium 

>0.4  High 


We  suggest  that  any  one  of  the  "one-on-one"  combat  models  available  to  TACOM 
be  used  to  estimate  the  expected  survival  probability  increase.  Further,  we 
suggest  that  such  one-on-one  model  be  exercised  over  realistic  situation 
variability  (e.g.,  spectral  visibility  conditions)  to  generate  a  distribution 
for  survival-probability-increase  values  as  input  to  SUMMET.  This  last 
suggestion  stems  from  the  notions:  that  situation  variability  is  real;  that 
survival  probability  changes  with  the  situation;  and  that  trying  to  capture 
probability  of  survival,  and  its  potential  increase,  in  discrete  average 
numbers  is  not  taking  advantage  of  the  more  realistic  distribution  of  values. 

• 

To  illustrate  the  envisioned  use  of  a  one-on-one  combat  model  to  generate 
inputs  to  SUMMET,  consider  the  following  example.  Suppose  that  a  proposed  CM 
is  to  counter  two  specific  threat  systems  by  degrading  their  ability  to  track 
the  protected  vehicle,  given  a  detection.  Further  suppose  that  these  threat 
systems  are  present  in  scenarios  characterized  by  a  representative  terrain  and 
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range  of  spectral  visibility  conditions.  The  one-on-one  model  could  then  be 
exercised  over  a  "matrix"  of  one-on-one  runs  covering  the  two  threat  systems 
and,  say,  three  positions  per  threat,  three  vehicle  penetration  paths  per 
threat  position,  and  three  visibility  conditions.  Each  of  these  54  runs  would 
be  made  first  without  the  CM  and  then  with  it.  The  difference  between  each 
with-CM  and  without-CM  run  would  be  tallied  as  a  histogram  or  distribution  of 
performance  effectiveness  (E)  values  for  input  to  SUMMET. 

A  key  requirement  for  the  suggested  use  of  a  one-on-one  combat  model  is  that 
such  model  have  the  capability  to  1)  account  for  the  threat  capability  to 
detect,  acquire  or  track,  hit,  and  kill  a  vehicle;  and  2)  reflect  the 
degradation  of  any  of  these  threat  capabilities  by  a  CM  of  interest. 

2.2.5.  Combat  Effectiveness  and  Utility.  Whereas  performance  effectiveness 
of  a  proposed  CM  addressed  the  benefit  afforded  to  a  single  combat  vehicle, 
combat  utility  addresses  the  benefit  afforded  to  a  combat  force,  in  other 
words,  performance  effectiveness  asks,  "Did  I  save  the  vehicle?"  while  combat 
utility  asks,  "Did  i  win  the  battle?" 

As  with  the  other  CM  decision-dimensions,  there  are  numerous  ways  to 
characterize  combat  utility,  C.  The  characterization  we  suggest  for  C  is  one 
that  would  be  supported  by  a  "force-on-force"  evaluation.  Specifically,  let 
combat  effectiveness,  C,  be  defined  as  the  "improvement  in  fractional  casualty 
ratio"  afforded  by  a  proposed  CM  in  a  force-on-force  engagement,  where 
fractional  casualty  ratio  is  the  outcome  percent  of  "red"  losses  divided  by 
the  outcome  percent  of  “blue"  losses  and  where  an  outcome  ratio  value  of  1.0 
may  be  viewed  to  represent  a  draw,  if  F  is  the  fractional  casualty  ratio 

CO 

value  without  the  proposed  CM,  and  if  f  is  the  value  with  the  CM,  then  C  = 

cw 

<Fcw  ”  Fco>/Fco* 
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Let  the  combat  effectiveness  utility,  U(C),  be  defined  as: 


C, 

improvement  in 
Fractional 

Casualty  Ratio  U(C) 

<0.2  Low 

>0.2  but  <0.4  Medium 

>0.4  High 


In  the  force-on  force  evaluation  of  combat  effectiveness,  c,  a  combat  model  or 
simulation  would  be  exercised  over  a  matrix  of  representative  combat  scenarios 
to  account  for  a  realistic  variability  in  force  mixes  and  in  scenario 
environments.  The  matrix  of  runs  would  be  made  with  and  without  the  benefit 
of  the  proposed  CM  to  generate  a  histogram  or  distribution  of  C  values. 

The  force-on-force  approach  to  combat  effectiveness  requires  that  a  rapidly 
executable  force-on-force  model  be  available.  We  know  that  TACOM  is  seeking 
to  have  such  a  model  at  their  disposal.  When  available,  such  a  model  could 
tie  nicely  into  the  force-on-force  approach  for  combat  utility  assessment  in 
SUMMET.  We  do  already  have  one  such  programmed  model  available  for  use.  It 
is  called  SPIFFI  and  is  documented  in  Honmeywell  Report  No.  80SRC89,  dated 
November  1980  and  entitled,  "SPIFFI,  a  Lanchester  Combat  Model." 

2.2.6.  user  Acceptance  and  Utility.  The  acceptance  dimension.  A,  measures 
user  acceptance  of  a  proposed  CM  system  on  the  basis  of  a  number  of 
characteristics.  These  characteristics  indicate  the  attraction  or  resistance 
likely  to  be  encountered  if  the  R&D  effort  is  successful  and  the  CM  system  is 
proposed  for  implementation.  We  have  identified  eight  user  acceptance 
criteria: 


o 

User 

Need 

o 

Time 

to  Field 

o 

Retrof itability 
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o 


Retrofit  Cost 
o  Operations  Cost 
o  Support  Cost 

o  Tactics  impact 

o  Useful  Life  Span 

This  list  may  not  be  complete,  but  for  the  purposes  of  this  discussion,  we 
will  suppose  that  it  is.  The  user  acceptance  evaluation  method  we  will 
describe  is  easily  adapted  to  any  alteration  in  the  list  of  criteria,  in 
brief,  the  listed  criteria  are  defined  as  follows: 

o  User  Need — This  criterion  is  an  estimate  of  how  much  the  user 
believes  he  needs  the  system. 

o  Time  to  Field — How  pleased  (or  displeased)  the  user  will  be  with  the 
amount  of  time  needed  to  implement  the  system, 
o  Retrof itability— How  easily  the  CM  system  is  retrofitted  to  present 

vehicles. 

o  Costs — How  accepting  the  user  will  be  to  the  costs  of  investment, 

retrofit,  operation  of  the  CM  system,  and  support  systems  for  the  CM 
system. 

o  Tactics  Impact — How  adaptable  the  user  is  to  any  change  in  tactics 
required  for  the  effective  use  of  the  CM  system, 
o  Useful  Life  Span — How  acceptable  to  the  user  the  expected  life  span 
is  before  technological  obsolescence. 

Now  suppose  each  user  acceptance  criterion  has  a  value  of  high,  medium,  or  low 
and  that  these  translate  into  the  numbers  0.0,  0.5,  and  1.0,  where  1.0  is 
assigned  to  high  user  acceptance,  0.5  to  medium  acceptance,  and  0.0  to  low 
acceptance.  Notice  that  we  describe  the  acceptance  criteria  in  such  a  way 
that  high  is  always  associated  with  positive  user  acceptance. 
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Let  C,  ,  C„...,C  stand  for  each  of  the  acceptance  criteria  (n  =  8  for 
1  2  n 

the  set  of  criteria  we  have  determined  above).  Let  V(C^)  be  the  acceptance 
value  (i.e.,  1.0,  0.5,  or  0.0)  of  C^.  If  each  acceptance  criteria  were 
equally  important,  then  the  net  CM  user  acceptance  value.  A,  is  the  average. 


A  = 


n 

Z 

i  =  1 


Vtcp 


-  n 


But  generally,  some  criteria  will  be  more  important  than  others  and  should 
carry  more  weight  in  the  net  value.  Let  W(C^)  be  the  weighting  factor  for 
the  relative  importance  of  criterion  C^,  and  let  the  values  W(C^)  be 
normalized  so  that 


n 

Z  =  1 

i  =  1 


(when  each  is  of  equal  importance,  W(C^  =  1/n) .  Then  the  value  of  A  is 
the  weighted  average: 

n 

A  =  Z 

i  -  1 

The  value  of  A  ranges  from  0.0  to  1.0,  depending  on  the  values  of  V(C^) 
(i.e.,  if  V^)  =  1  for  each  i,  then  A  =  1?  if  =  0.0  for  each  i, 

then  A  =  0.0)  . 


V(C.)  W(C.) 
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Now  the  user  acceptance  value  A  may  be  translated  into  a  high-medium-low 
utility  for  overall  user  acceptance  as  follows: 


A  U  (A) 

<0.33  Low 

>0.33  but  <0.67  Medium 

>0.67  High 


In  this  way  the  total  user  acceptance  value  may  be  calculated  (by  the  system) 
from  the  user  acceptance  values  of  its  inputs.  Both  inputs  and  output  are  on 
a  utility  scale  of  high,  medium,  or  low.  Fixed  values  for  the  W(C^),  which 
indicate  the  relative  importance  of  the  various  acceptance  criteria,  will  be 
determined  on  the  basis  of  expert  opinion  drawn  from  TACOM  and  the  user 
community. 

While  we  illustrated  user  acceptance  based  on  discrete  assignments  of  0.0, 
0.5,  or  1.0  values  to  each  acceptance  criterion,  SUMMET  can  allow  for  an 
uncertainty  range  of  values  to  be  assigned  (0.6  to  0.7,  for  example). 

2.3  Ranking 


As  we  noted  earlier,  work  in  Phase  II  of  SUMMET  development  will  include 
further  development  of  techniques  to  rank  acceptable  CM  proposals.  Heuristics 
and  algorithms  will  be  investigated.  Figure  2-6  exemplifies  one  cost  benefit 
algorithm  that  could  be  incorporated  in  SUMMET  as  a  ranking  means.  This  cost 
benefit  relationship  would  rank  highest  those  acceptable  CM  proposals  that 
have:  the  highest  utility  in  performance  effectiveness,  combat  effectiveness, 
and  user  acceptance;  the  least  R&D  risk;  and  the  least  r&d  cost. 

This  concludes  the  discussion  of  the  SUMMET  decision-aid  concept.  Let  us  now 
proceed  with  the  description  of  the  computer  aids  available  to  aid  manual 
exercise  of  the  SUMMET  concept. 
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COST  BENEFIT  = 


HUpe  +  Ucu  +  UJ/3]  [1  -  R&D  RISK) 
[R&D  COST  RATIO] 


Uno  =  EXPECTED  VALUE  OF  PERFORMANCE-EFFECTIVENESS  UTILITY 

Ucu  =  EXPECTED  VALUE  OF  COMBAT  UTILITY 

Uua  =  EXPECTED  VALUE  OF  USER  ACCEPTANCE  UTILITY 

R&D  RISK  =  EXPECTED  VALUE  OF  DEVELOPMENT  RISK 

R&D  COST  RATIO  =  EXPECTED  VALUE  OF  N-YEAR  DEVELOPMENT  COST  OF  A  CM 
AS  A  FRACTION  OF  N-YEAR  BUDGET  AVAILABLE  FOR  ALL  CM 
DEVELOPMENTS 


Figure  2-6.  A  Cost  Benefit  Algorithm  for  Ranking  of  Proposed  CM  Developments 


3.0.  SUMMET  I  USERS'  GUIDE 

This  section  is  intended  to  serve  as  a  users'  guide  for  the  SUMMET  I  computer 
program.  The  SUMMET  I  program  is  available  on  the  PRIME  computer  at  the  U.S. 
Army  Tank-Automotive  Command,  Warren,  Michigan.  The  program  is  accessed 
through  TYMNET  or  through  direct  dial-up. 


As  noted  earlier,  SUMMET  I  is  a  program  to  aid  the  manual  exercise  of  the 
SUMMET  decision-aid  concept.  SUMMET  I  is  not  intended  to  represent  a  final 
computerized  and  interactive  version  of  SUMMET.  Rather,  it  is  intended  to 
facilitate  the  testing,  evaluation,  and  refinement  of  the  SUMMET  decision-aid 
concept  that  will  occur  in  Phase  II. 
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The  material  in  this  section  is  organized  into  three  main  parts: 

1.  A  set  of  input  specification  sheets  that  describe  the  nature  and 
format  of  each  of  the  SUMMET  I  input  data  records.  These 
specification  sheets  also  serve  to  further  describe  the  character  of 
the  data  on  which  the  SUMMET  concept  is  based. 

2.  An  annotated  terminal  session  that  takes  a  person  through  all  the 
steps  necessary  to  login,  enter  data,  execute  the  program,  and  review 
the  program  output. 

3.  Reference  material  that  includes  a  complete  program  listing,  a 
complete  set  of  sample  inputs,  and  the  corresponding  sample  output. 

3.1.  Input  Specification 

The  following  pages  are  a  set  of  format  specifications  for  each  of  the  data 
records  used  in  the  SUMMET  I  program.  Each  record  format  is  identified  by  a 
Record  Type  Number.  Following  the  set  of  input  format  specification  pages  is 
a  set  of  blank  forms  without  the  descriptive  information.  These  forms  may  be 
copied  and  used  for  SUMMET  I  data  inputs. 

3.1.1.  Format  Specifications. 


RECORD  TYPE  1 


_2 

5. 

_ 

6 

Record  Type  1  is  used  to  input  the  number  of  decision-dimensions. 
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RECORD  TYPE  2 


_1_ 

5. 

1 

3 

Record  Type  2  is  used  to  input  the  number  of  decision  heuristics. 


RECORD  TYPE  3 


3_ 

_6 

_9 

12. 

15 

I! 

21 

t 

1 

L 

* 

L 

+ 

M 

# 

M 

— 

M 

+ 

H 

* 

M 

A  I  II  III  IV  V  VI 


Record  Type  3  is  used  to  input  the  decision  heuristics,  one  record  is  needed 
for  each  of  the  heuristics. 

The  data  field  labeled  "A"  is  an  index  field  for  numbering  the  heuristics. 

The  data  fields  labeled  i  through  VI  correspond  to  the  six  decision-dimensions. 
They  are  as  follows: 

I  Development-time  utility 
II  Development-risk  utility 
III  Development-cost  utility 
IV  Performance-effectiveness  utility 
V  Combat-utility 
VI  User-acceptance  utility 
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The  utility  of  each  of  the  decision-dimensions  is  coded  using  the  following 
symbols: 

L*:  Low  utility 

L+:  Low,  medium,  or  high  utility 
M* :  Medium  utility 
M-:  Medium  or  low  utility 
M+:  Medium  or  high  utility 
H*:  High  utility 

The  utility  of  each  of  the  decision-dimensions  is  defined  in  terms  of  a 
characteristic  parameter.  Figures  3-1  and  3-2  define  two  types  of  utility 
functions  used  in  defining  the  data  fields  for  Record  Type  4. 


0 

A 

.2  1  .4 

•6  V 

1.0 

A 

■1  * 

A  i 

0 

1 

* 

+1 

A 

T 

LO 

▼ 

PI 

P2 

T 

HI 

T  T 

LO  PI 

P2 

T 

HI 

Figure  3-1.  Utility  Function  Type  1  Figure  3-2.  Utility  Function  Type  3 
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RECORD  TYPE  4 


Record  Type  4  is  used  to  input  the  utility  functions  shown  above. 

Data  field  "A"  is  the  index  of  the  decision-dimension.  Data  field  "TYPE"  is  a 
1  or  3,  as  shown  in  Figures  3-1  and  3-2.  Data  fields  "LO"  and  "HI"  define  the 
minimum  and  maximum  value  of  the  characteristic  parameter.  Data  fields  "P^" 
and  "P2"  define  the  lower  and  upper  values  of  the  characteristic  parameter 
defining  the  medium  utility. 

RECORD  TYPE  5 


lL 

lSi 

r 

i 

rl 

rl 

Record  Type  5  is  used  to  control  the  routines  used  for  inputting  data. 

A  zero  (0)  in  column  5  indicates  that  the  likelihood  levels  for  each  of  the 
decision-dimensions  will  be  determined  outside  of  the  program.  This  array 
will  be  input  using  record  type  12. 

A  one  (1)  in  column  5  indicates  that  the  likelihood  levels  for  each  of  the 
decision-dimensions  will  be  calculated  inside  the  program.  The  likelihood 
levels  are  a  function  of  the  utility  of  the  decision-dimension  (input  using 
Record  Type  4) ,  and  the  distribution  of  the  characteristic  parameter  of  the 
decision  parameter  (input  using  Record  Type  7). 
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RECORD  TYPE  6 


L± 

_ 

_ 

_ 

L_§J 

_ 

_ 

_ 

Llfl] 

_ 

_ 

_ 

LJ 

151 

_ 

_ 

_ 

>TTW 

LJ 

_ 

_ 

m 

_ 

_ 

_ 

LJ 

FIT 

I 

1 

■ 

1 

1 

1 

1 

■ 

1 

1 

1 

1 

1 

1 

1 

1 

■ 

1 

1 

II 

1 

1 

1 

l 

l 

l 

■ 

1 

■1 

r~ 

n 

n 

i 

n 

n 

rn 

i 

m 

1 

Record  Type  6  is  used  to  input  an  identifying  title  on  the  computer  output  for 
this  project. 


RECORD  TYPE  7 


JL 

_s 

LLOj 

1 

3 

ri 

A  B 


Field  "A"  of  Record  Type  7  is  used  to  define  the  parameter  index.  Field  B  is 
used  to  define  the  type  of  distribution  associated  with  the  characteristic 
parameter.  A  one  (1)  in  column  10  indicates  the  beta  distribution,  as 
illustrated  in  Figure  3-3. 


Figure  3-3.  Beta  Distribution  Parameters 
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RECORD  TYPE  8 


1 1 

_ 

_5j 

_ 

_ 

_ _ 

_ 

in 

_ 

_ 

LJ 

1 15 1 

LJ 

LJ 

LJ 

LJ 

|20] 

1 

1 

■ 

1 

2 

1 

1 

1 

1 

2 

■ 

1 

1 

I 

B 

1 

1 

B 

■ 

I 

n 

rn 

rn 

m 

n 

i 

TYPE  IDD  DA  DB 


Record  Type  8  is  used  to  input  the  parameters  necessary  to  define  a  unique 
beta  distribution. 


Data  field  "TYPE"  is  used  to  input  the  index  of  the  beta  distribution  shape 
selected  from  Figure  3-4. 


SKEWED  - 


HIGH 

VARIANCE 


0  .06  .29  .67  1.0 


MEDIUM 

VARIANCE 


LOW 

VARIANCE 


I _ I _ I _ I - 1 

0  .01  .13  .61  1.0 


SYMMETRIC 


0  .05  .5  .95  1.0 


SKEWED  + 


0  .33  .71  .94  1.0 


1 _ I - 1 - 1 - 1 

0  .37  .81  .98  1.0 


t  i _ J - 1 - » 

0  .39  .87  .99  1.0 


Figure  3-4.  Beta  Distribution  Types 


33 


Given  the  shape  of  the  beta  distribution*  any  two  of  the  parameters  (MIN* 
MODE*  or  MAX)  shown  in  Figure  3-3  are  sufficient  to  define  a  unique 
distribution. 


Data  field  "IDD"  is  used  as  an  indicator  for  the  pair  of  parameters  that  will 
be  used. 


If 

M 

O 

D 

H 

•— 1 

then 

DA 

* 

MIN 

DB 

S 

MAX 

If 

IDD  *  2 

then 

DA 

s 

MIN 

DB 

a 

MODE 

If 

IDD  *  3 

then 

DA 

a 

MODE 

DB 

s 

MAX 

RECORD  TYPE  7 


_1_ 

_5 

_ 

10, 

2 

2 

A  B 


Field  "A"  of  Record  Type  7  is  used  to  define  the  parameter  index.  Field  »b" 
is  used  to  define  the  type  of  distribution  associated  with  the  characteristic 
parameter.  A  two  (2)  in  column  10  indicates  a  histogram  type  distribution*  as 
shown  in  Figure  3-5. 


RECORD  TYPE  9 


_1_ 

J5 

4 

Record  Type  9  is  used  to  input  the  number  of  segments  in  the  histogram. 
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.40 


PARAMETER 

Figure  3-5.  Histogram  Distribution  Parameters 


RECORD  TYPE  10 


M 

l_5| 

ULflj 

MS 

1201 

t 

i 

0 

• 

5 

1 

• 

5 
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• 

1 

3 

ri 

A 

Ml 

1 

MA 

X 

Dl 

NS 

TY 

There  is  one  Record  Type  10  for  each  histogram  segment. 

Data  field  "A"  is  the  segment  index.  Data  fields  "MIN"  and  "MAX"  correspond 
to  the  lower  and  upper  bounds  of  the  characteristic  parameter.  Data  field 
"DENSITY"  is  the  density  of  the  segment. 

RECORD  TYPE  7 

n  i  in  !  1 1  n 


3 


3 


Field  "A"  of  Record  Type  7  is  used  to  define  the  parameter  index.  Field  "b" 
is  used  to  define  the  type  of  distribution  associated  with  the  characteristic 
parameter.  A  three  (3)  in  column  10  indicates  a  discrete  distribution,  as 
shown  in  Figure  3-6. 


PARAMETER 


Figure  3-6.  Discrete  Distribution  parameter 


RECORD  TYPE  11 


_1_ 

_ 1 

Ljji 

J 

2 

S 

i 

1 

§ 

Record  Type  11  is  used  to  input  the  discrete  value  of  the  characteristic 
parameter.  A  small  value  is  built  into  the  program  and  is  used  to  define  a 
one-segment  histogram  centered  at  the  discrete  value. 
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RECORD  TYPE  12 


lU 

LJ 

_ 

LJ 

jj. 

LJ 

LJ 

_ 

LJ 

110] 

LJ 

LJ 

LJ 

LJ 

15. 

LJ 

LJ 

LJ 

LJ 

go  i 

1 

1 

■ 

■ 

i 

1 

1 

D 

1 

■ 

1 

E 

■ 

D 

5 

■ 

D 

■ 

E 

D 

— 

m 

rn 

m 

n 

rn 

m 

rn 

m 

m 

i 

A  LO  MED  Ht 


Record  Type  12  is  used  when  the  likelihood  levels  of  the  decision-dimensions 
are  calculated  outside  of  the  program. 

Data  field  "a"  is  the  index  of  the  decision-dimension.  Data  fields  "LO," 
"MED,"  and  "HI"  are  likelihood  probabilities  for  the  low,  medium,  and  high 
utility  of  the  decision-dimension. 

One  record  is  necessary  for  each  dimension. 


3.1.2.  Blank  Forms. 

RECORD  TYPE  1 
I  1 1  I  I  I  5 1 


RECORD  TYPE  2 


Lii 

_ 

i 

1 
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RECORD  TYPE  4 

I  1  1  1  1  1  5  |  i 

1  l  1 10,  i 

i  l  |15|  | 

1  1  |20.  | 

1  1  1 25 1  |  | 

1  1  1 30 1 

RECORD  TYPE  5 
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RECORD  TYPE  6 
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3.2.  Annotated  Terminal  Session 


With  SUMMET  I  input  specification  now  defined,  let's  walk  through  all  of  the 
steps  necessary  to  login,  enter  data,  execute  the  program,  review  program 
output,  and  logout. 

The  PRIME  computer  is  under  the  control  of  the  PRIMOS  operating  system.  There 
are  a  number  of  system-level  commands  and  a  text  editor  that  a  user  must 
become  familiar  with  in  order  to  use  the  SUMMET  I  program.  The  user  should 
refer  to  Figure  3-7  to  follow  the  flow  of  the  terminal  session.  After  login 
the  user  has  several  options  available,  depending  on  the  status  of  previous 
terminal  sessions.  If  a  user  has  previously  used  SUMMET  I,  he  may  find  it 
necessary  only  to  modify  previous  input  data  before  executing  the  program. 
First-time  users  will  have  to  build  a  complete  set  of  input  data  files. 

The  annotated  terminal  session  is  presented  here  using  sets  of  opposing  pages, 
as  exemplified  by  Figure  3-8.  In  each  set,  the  right-hand  page  is  a  printout 
made  at  a  hard  copy  terminal  from  an  actual  terminal  session.  The  left-hand 
page  is  a  set  of  comments  explaining  what  is  happening  on  the  right-hand 
page.  Each  of  the  system  level  options  shown  in  Figure  3-7  are  represented  in 
the  annotated  terminal  session. 
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LOGIN 


Figure  3-7.  Terminal  Session  Flow  for  SUMMET  I 
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Login  Procedure 


To  access  the  SUMMET  I  program,  you  must  dial  up  the  PRIME 
computer  at  the  Tank-Automotive  Command,  Warren,  Michigan. 
Begin  by  putting  your  terminal  in  even  parity,  full  duplex  mode. 
Then  dial  1-313*574-6657  and  wait  for  the  carrier  signal.  Place 
the  telephone  headset  in  the  modem  cradle  and  watch  for 
the  carrier  indicator  to  light  on  the  modem.  This  signals  a 
completed  connection  between  your  terminal  and  the 
PRIME  computer.  The  PRIME  computer  may  at  this  time 
respond  with  "OK,"  which  is  its  command  level  prompt. 

It  may  also  not  send  the  "OK,"  prompt,  but  just  sit  and 
wait  for  your  LOGIN  command. 


To  login  to  the  system,  type: 

LOGIN  GILLES  {appropriate  password)  -ON  DR  AS  (carriage 
return  (CR)) 

All  command-level  responses  are  followed  by  a  carriage 
return  and  the  explicit  directions  to  do  so  will  be  omitted 
from  here  on. 


The  PRIME  then  prints  out  the  login  identification  optionally 
followed  by  system  messages,  and  finally  by  the  system 
prompt  "OK,". 


If  at  any  time  you  issue  an  invalid  system  command,  the 
PRIME  will  respond  with  an  error  declaration  followed  by  a 
different  system  prompt  "ER,".  This  is  logically  equivalent 
to  "OK,"  and  you  may  retype  your  command  or  type  a  new  one. 


OK,  LOGIN  GILLES  PASSWORD  —ON  DRAS 
PRIMENET  18.3.1  DRAS 


PRIMOS  Version  18.3.1 

GILLES  (55)  LOGGED  IN  AT  14:54  012683 

Access  Information  (i.e..  Phone  Numbers,  Passwords,  etc.)  shall 

'FOR  OFFICIAL  USE  ONLY'  material!!! 

SCIENTIFIC  &  ENGINEERING  COMPUTER  NETWORK 
United  States  Army  Tank-Automotive  Command 
Research  &  Development  Center 
Comp  Mgt  &  Appl  Rsch  Ofc,  drsta-ry 
Warren,  Michigan  48090,  Ph:  (313)  574-6548 

OK, 


OK.  FIDDLEFADDLE 

Not  found.  FIDDLEFADDLE  (std$cp) 

ER! 


J 


Figure  3-8.  Format  of  Annotated  Terminal  Session 
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3.2.1.  Login  Procedure,  to  access  the  SUMMET  I  program,  you  must  dial-up  the 
PRIME  computer  at  TACOM,  Warren,  Michigan.  Begin  by  putting  your  terminal  in 
even  parity,  full  duplex  mode.  Then  dial  1-313-574-6657  and  wait  for  the 
carrier  signal.  Place  the  telephone  headset  in  the  modem  cradle  and  watch  for 
the  carrier  indicator  to  light  on  the  modem.  This  signals  a  completed 
connection  between  your  terminal  and  the  prime  computer.  The  PRIME  computer 
may  at  this  time  respond  with  "OK,"  which  is  its  command  level  prompt,  it 
also  may  not  send  the  "OK,"  prompt,  but  just  sit  and  wait  for  your  "LOGIN" 
command. 


To  login  to  the  system,  type: 

LOGIN  GILLES  (appropriate  password)  -ON  DRAS  (carriage  return  (CR) ) 

All  command-level  responses  are  followed  by  a  carriage  return  and  the  explicit 
directions  to  do  so  will  be  omitted  from  here  on. 

The  PRIME  then  prints  out  the  login  identification,  followed  by  optional 
system  messages,  and  finally  by  the  system  prompt  "OK,". 


If  at  any  time  you  issue  an  invalid  system  command,  the  prime  will  respond 
with  an  error  declaration  followed  by  a  different  system  prompt  "ER, ".  This 
is  logically  equivalent  to  "OK,"  and  you  may  retype  your  command  or  type  a  new 
one. 
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O' 

o 

o 

o 

o 

o 

o 

Q  OK, LOGIN  ACCOUNT  PASSWORD  -ON  DR AS 
PRIMENET  18.3.1  BRAS 

O 

PRIMOS  Version  18.3.1 

°  GILLES  (53)  LOGGED  IN  AT  13:49  052783 

Please  Regard  Login  Data  And  Access  Phone  Nunbers  As  FOUO 

SCIENTIFIC  X  ENGINEERING  COMPUTER  NETWORK  (BRAS) 
q  United  States  Arny  Tank-Autonotive  Connand 
Research  X  Bevelopnent  Center 
q  Conp  Mgt  X  Appl  Rsch  Ofc,  DRSTA-RY 

Warren,  Michigan  48090,  F‘h:  (313)  574-6228 

O 

OK, 

O 

O 

O  OK,  FIDDLER ADDLE 

Not  found.  FIDDLEFADDLE  (stdicp) 

O  ER! 

O 


O 

O 

O 

O 

O 

O 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 


o 

o 

o 

o 


o 

o 

o 

o 

o 
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3.2.2  Build  SUMMET  I  Data  File  SUMIF5.  to  enter  data  into  a  file  for  use 
with  the  SUMMET  I  program,  you  will  be  using  the  PRIME  Text  Editor.  To  begin 
entering  data  into  a  new  file,  type 


ED 

after  the  normal  system  prompt  "OK,".  The  PRIME  Text  Editor  will  respond  by 
telling  you  that  it  is  in  the  INPUT  mode  and  give  you  the  INPUT  mode  prompt 

You  may  now  begin  typing  the  input  records  for  the  projects  you  wish  to 
evaluate.  The  format  of  each  of  the  data  records  are  described  in 
Section  3.1.1. 

After  each  record  is  entered,  the  PRIME  will  return  with  the  input  mode  prompt 
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o 

OK,  ED 

O 

o 

INPUT 

Til  1 

O 

o 

3  THREAT  WARNING  /  REACTION  SYSTEM 

O  i  i 

0 

0 

<\  1 

8  5 

i 

i 

3.0  5.0 

O 

3  2 

9 

o 

3  1 

S  1 

o.t 

0.3  1.0 

0 

o 

Til  3 

i 

O 

3  5 

i 

0.03  0.0 6 

O 

o 

Til  4 

9 

Til  4 

O 

o 

&  1 

0.0 

0.2  0.2 

S  2 

0.2 

0.4  0.3 

O 

o 

a  3 

0.4 

0.6  0.4 

o 

a  4 

a  5 

0.6 

2 

0.8  0.1 

o 

o 

.?!  3 

a  i 

0.0 

0.2  0.2 

o 

o 

a  2 

0.2 

0.4  0.7 

o 

a  3 

0.6 

0.3  0.1 

o 

a  a 

3 

o 

a  o.2i 

o 

a  ir  sup 

■PRESSOR  -  LOU  RISK 
•1 

o 

o 

8  J 

8  7 

1 

1 

1.0  2.5 

o 

a  2 

•..1 

o 

a  o.i8 

o 

a  3 

1 

0 

o 

a  7 

1 

.008  .015 

a  4 

9 

o 

a  3 

o 

a  i 

0.0 

0.2  0.60 

o 

o 

a  2 

0.2 

0.4  0.20 

o 

a  3 

a  5 

0-4 

2 

0.6  0.20 

o 

9 

o 

o 

a  i 

0.0 

0.2  0.95 

o 

a  2 
a  6 

0.4 

3 

0.6  0.05 

o 

o 

a  0.40 

o 

o 

o 

o 

o 
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When  you  have  completed  all  of  the  input  data  records,  you  strike  a  carriage 
return  following  the  INPUT  mode  prompt.  The  text  editor  then  changes  to  the 
EDIT  mode  and  responds  with  the  EDIT  Mode  prompt 

At  this  point,  you  should  type 
TOP 

to  return  to  the  beginning  of  the  input  data  records.  Then  type 
P  100 

to  print  100  lines  of  your  input  file.  The  complete  syntax  of  this  command  is 
(P)RINT  n 

where  P  is  the  abbreviated  form  and  n  is  the  number  of  lines. 

The  text  editor  then  lists  your  entire  file  (since  it  was  less  than  100 
records) .  The  five-digit  number  to  the  left  of  the  colon  is  a  virtual  pointer 
and  is  not  part  of  your  file.  Each  of  the  data  records  should  be  carefully 
checked  for  accuracy  and  completeness. 
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o 

O 

a  IR  SUPPRESSOR 

•  HIGH  RISK 

o 

a  i 

1 

o 

a  ? 

1 

1.0 

2.5 

0 

a  2 

3 

o 

a  o.6 

0 

a  3 

1 

o 

a  7 

1 

0.03 

0.06 

o 

a  4 

9 

0 

a  3 

o 

a  i 

0.0 

0.2 

0.2 

o 

o 

a  2 

0.2 

0.4 

0.4 

o 

a  3 

0.4 

0.6 

0.4 

o 

&  j 

a  3 

9 

o 

o 

a  i 
a  2 

0.0 

0.2 

.30 

o 

0.2 

0.4 

.40 

o 

a  3 

0.4 

0.6 

.30 

o 

6 

3 

o 

a  o.40 

o 

o 

%  TOP 

o 

o 

$  P  100 

o 

.NULL. 

o 

OOOOI : 

1 

o 

00002: 

THREAT  WARNING 

/  REACTION  SYSTEM 

o 

00003: 

00004: 

1 

5 

1 

1 

3.0 

5.0 

o 

o 

00005: 

2 

•J 

o 

00006: 

1 

o 

00007: 

1 

0.1 

0.3 

1.0 

o 

o 

00008: 

3 

i 

o 

00009: 

5 

i 

0.03 

0.06 

o 

OOOIO: 

4 

2 

0 

0001 1 : 

4 

o 

00012: 

1 

0.0 

0.2 

0.2 

o 

OOQ'1 3 : 

2 

0.2 

0.4 

0.3 

o 

00014: 

3 

0.4 

0.6 

0.4 

o 

00015: 

4 

0.6 

0.8 

0.1 

o 

00016: 

5 

9 

o 

00017: 

00013: 

3 

1 

0.0 

0.2 

0.2 

o 

o 

00019: 

2 

0.2 

0  •  4 

0.7 

o 

00020: 

3 

0 . 6 

0.8 

0.1 

o 

00021 : 

6 

3 

_o 

00022: 

0.21 

o 
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After  a  comparison  of  each  of  the  input  records  and  the  data  input  sheets, 
assume  that  you  have  found  errors  in  records  4,  22,  37,  38,  and  43  and  wish  to 
correct  the  errors. 
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o 

o 

o 

OOC23; 

IR  SUP PRES 

SOR  -  LOU  RISK 

0 

o 

00024: 
00025 : 

1 

1 

/ 

1 

1 

1.0  2.5 

0 

o 

00024 s 
00027: 

2 

0,13 

3 

o 

o 

00028: 

A 

1 

.008  .015 

o 

00029: 

7 

1 

o 

00030: 
00031 ; 

4 

3 

n 

0 

o 

00032: 

1 

0.0 

0.2  0.60 

o 

00033: 

*> 

L 

0.2 

0.4  0.20 

o 

00034: 

3 

0.4 

0.6  0.20 

o 

00035: 

C 

■J 

n 

o 

00034: 

2 

o 

00037: 

1 

0.0 

0.2  0.95 

o 

o 

00038: 

2 

0.4 

0.4  0.05 

00039: 

6 

3 

o 

o 

00040: 

0.40 

00041  : 

IR  SUP  PRES 

SOR  -  HIGH  RISK 

o 

o 

o 

00042: 

00043: 

1 

7 

1 

2 

1.5  2.0 

0 

00044: 

T 

L 

3 

00045: 

0.6 

o 

o 

00044: 

3 

1 

o 

00047: 

00048: 

7 

4 

1 

2 

0.03  0.06 

o 

o 

00049: 

3 

o 

00050: 

1 

0.0 

0.2  0.2 

o 

00051 : 

2 

0.2 

0.4  0.4 

0 

00052: 

3 

0.4 

0.6  0.4 

o 

00053: 

5 

9 

o 

00054; 

3 

o 

00055: 

1 

0.0 

0.2  .30 

o 

00054: 

2 

0.2 

0.4  .40 

o 

o 

00057: 

3 

0.4 

0.6  .30 

00058: 

4 

■7 

o 

o 

00059: 

BOTTOM 

0.40 

0 

o 

o 

o 

o 

0 

o 

o 
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You  begin  the  corrections  by  moving  the  EDIT  mode  pointer  to  record  4  by  typing 
PO  4 

This  is  the  abbreviated  form  of 
(PO) INT  n 

where  n  is  the  record  identifier.  The  text  editor  lists  the  contents  of  that 
record  and  you  correct  the  invalid  part  by  typing 
C  /3.0  5/1.0  3/ 

This  is  the  abbreviated  form  of 
(C)HANGE  /stringl/string2/ 

You  must  select  "stringl"  in  such  a  manner  so  as  to  ensure  uniqueness  within 
the  entire  record.  The  text  editor  signals  the  completion  of  the  CHANGE 
command  by  listing  the  contents  of  the  revised  record. 

After  you  are  satisfied  with  the  new  contents  of  record  4,  you  move  on  to 
record  22  by  typing 
PO  22 

followed  by 
C  /21/71/ 

to  correct  the  incorrect  entry  "21". 

Record  37  is  correctd  in  a  similar  fashion,  you  may  then  move  to  record  38  by 
typing 
N 

which  is  the  abbreviated  form  for 
(N) EXT 
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o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 


$  PQ  A 

00004:  5  1  3.0  5.0 

$  C  /3.0  5/1.0  3/ 

00004:  5  1  1.0  3.0 


$  P0  22 
00022:  0.21 
if  C  / 2 1  /?'l  / 
00022:  0.71 


if  PQ  37 

00037:  I  0.0  0.2  0.95 

*  C  /95/75Z 

00037:  1  0.0  0.2  0.75 

if  N 

00038:  2  0.4  0.6  0.05 

$  C  705/25/ 

00033:  2  0.4  0.6  0.25 


O 

O 

O 

O 

O 

O 

O 

O 

O 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 
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Now  you  move  on  to  record  43  and  find  that  it  has  several  errors  and  it  would 
be  easier  to  retype  the  entire  record,  you  begin  the  correction  by  typing 
D 

which  is  short  for 
(D)ELETE  n 

where  n  is  the  number  of  lines  you  wish  to  delete,  beginning  at  the  current 
pointer  location.  In  the  example  you  will  see  that  the  PRINT  command  has  been 
used  to  show  that  a  NULL  line  is  now  at  record  43.  This  is  not  generally 
necessary  when  deleting  a  record. 

The  new  record  is  put  into  the  file  by  typing 

I  7  1  1.0  2.5 

The  complete  syntax  for  this  comand  is 
(I)NSERT  new  data  record 

Note  that  there  is  a  space  following  the  letter  I  or  the  word  INSERT  that  is 
not  part  of  the  new  data  record. 

You  may  check  the  alignment  of  the  data  in  the  new  record  by  typing 
P  2 

which  prints  two  records  to  help  you  check  that  the  data  in  record  43  is  in 
the  correct  columns. 
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o 

• 

O 

o 

$  PO  43 
00043; 

1 

l 

2  1.5  2„0 

o 

o 

$  D 

$  p 

o 

o 

.NULL. 

*  :i 

7 

1  1.0  2.5 

o 

o 

$  P  2 

o 

00043  s 

f 

1  1.0  2.5 

0 

o 

00044: 

9 

3 

o 

o 

o 

o 

o 
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o 

0 

o 

o 
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o 

o 

o 

o 

0 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o _ 

o 
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After  you  have  made  all  of  the  corrections  to  your  data  file,  you  should 
return  to  the  top  of  the  data  file  and  once  again  list  the  entire  contents  of 
the  file  by  typing 
P  100 

and  check  each  of  the  records  one  more  time,  if  you  are  working  at  a  terminal 
which  is  producing  a  hard  copy,  this  final  listing  of  your  data  file  may  be 
saved  as  a  permanent  record  of  your  inputs. 
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o 

*  TOP 

• 

O 

o 

*  P  100 

O 

.NULL 

a 

o 

ooooi 

1 

O 

00002 

THREAT  WARNING  /  REACTION  SYSTEH 

o 

00003 

1 

1 

O 

00004 

5 

1 

1.0  3.0 

o 

00005 

■J 

2 

O 

00006 

00007 

1 

1 

0.1 

0.3  1.0 

o 

0 

00008 

3 

1 

o 

00009 

5 

1 

0.03  0.06 

0 

OOOIO 

4 

2 

o 

0001  1 
00012 

4 

1 

0.0 

0.2  0.2 

o 

o 

00013 

2 

0.2 

0.4  0.3 

o 

00014 

3 

0.4 

0.6  0.4 

o 

00015 

4 

0.6 

0.8  0.1 

o 

00016 

5 

2 

00017 

3 

o 

00018 

1 

0.0 

0.2  0.2 

o 

00019 

2 

0.2 

0.4  0.7 

o 

00020 

3 

0.6 

0.8  0.1 

o 

00021 

6 

3 

o 

00022 

0.71 

o 

00023 

IR  SUPPRESSOR  -  LOW  RISK 

o 

00024 

1 

1 

■o 

00025 

7 

1 

1.0  2.5 

o 

00026 

2 

3 

o 

00027 

0.18 

o 

00028 

00029 

3 

n 

/ 

1 

1 

.009  .015 

o 

o 

00030 

4 

2 

o 

00031 

3 

o 

00032 

1 

0.0 

0.2  0.60 

o 

00033 

2 

0.2 

0.4  0.20 

o 

00034 

3 

0.4 

0.6  0.20 

o 

00035 

5 

2 

00036 

2 

o 

o 

00037 

1 

0.0 

0.2  0.75 

00033 

2 

0.4 

0.6  0.25 

0 

00039 

6 

3 

o 

00040 

0.40 

o 

00041 

IR  SUPPRESSOR  -  HIGH  RISK 

o 

00042 

1 

1 

o 

00043 

*7 

i 

1 

1.0  2.5 

o 

00044 

2 

3 

o 

00045 

0.6 

o 

0 

o 
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The  data  £ile  which  you  have  just  created  is  only  a  temporary  £ile  and  would 
disappear  if  you  were  to  exit  the  text  editor  at  this  point,  to  save  your  new 
data  file,  type 
FILE  SUMIF5 

The  PRIME  responds  with  the  command  level  prompt  "OK,"  to  indicate  that  you 
have  saved  your  data  and  have  exited  from  the  text  editor. 
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o 

00046: 

3 

1 

00047: 

1 

/ 

1 

0.03 

0.06 

o 

00048: 

4 

o 

00049: 

3 

00050 : 

1 

0.0 

0.2 

0.2 

o 

00051  : 

2 

0.2 

0.4 

0.4 

00052: 

3 

0.4 

0.6 

0.4 

o 

00053: 

5 

o 

i. 

00054: 

3 

o 

00055: 

1 

0.0 

0.2 

.30 

00056: 

n 

0.2 

0.4 

.40 

o 

00057: 

3 

0.4 

0.6 

.30 

00058: 

6 

3 

o 

00059: 

BOTTOM 

0.40 

o 

%  FILE 

SUM  IF 

5 

OK, 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 


o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 


o 

o 

o 

o 


o 

o 

o 

o 

o 
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3.2.3.  Build  SUMMET  I  Data  File  SUMIF9.  This  is  the  second  data  file 
associated  with  the  SUMMET  I  program.  Data  are  entered  into  SUMIF9  in  the 
same  fashion  as  discussed  for  SUMIF5  using  the  PRIME  Text  Editor. 


62 


o 

01- 

l 

:n 

o 

INPUT 

o 

3 

/ 

o 

o 

3 

69 

o 

3 

1 

Hr 

Ht 

H+ 

H- 

L-t 

L-t 

o 

7 

L* 

Hi 

H  + 

Hr 

Lt 

L  + 

o 

3 

3 

L* 

Hi 

Hi- 

Hi 

L  + 

L-t 

o 

<5 

4 

H* 

Hi 

Li 

Hi 

H  + 

Lt 

o 

o 

J 

Li 

H-1 

Hi 

H: 

'  H  + 

L-t 

;> 

6 

M  + 

Ht 

H  + 

H- 

Hi 

Lt 

o 

o 

a 

7 

L* 

H* 

H+ 

H- 

Hi 

Lt 

■A 

8 

Li 

Hr 

Hi 

H- 

Hi 

Lt 

o 

* 

9 

L* 

Hf 

Hi 

Hi  H-t 

L-t 

(J 

o 

o 

X 

10 

Hi 

Li 

Hi 

H+  Hi 

Lt 

r\ 

3 

11 

H* 

H:* 

Li 

H: 

=  Hi 

L+ 

w 

o 

s 

12 

Hi 

Hi 

Li 

H: 

•  Hi 

Lt 

o 

3 

13 

H* 

L  1 

Hi 

H: 

Hi 

L-t 

r\ 

3 

14 

H* 

l* 

Hi 

H' 

=  Hi 

Lt 

o 

KJ 

3 

15 

H* 

M+ 

Li 

H- 

Li 

H-t 

D 

3 

1  6 

Hi 

Hi 

Li 

H 

=  Hi 

Ht 

o 

3 

1? 

Hi 

Hi 

Li 

H- 

:  H- 

Hr 

o 

& 

18 

Hi 

L-t 

H  + 

H; 

:  H- 

Ht 

o 

3 

19 

L* 

Hi 

Hi 

H 

‘  Li 

H-t 

o 

3 

20 

Hi 

L-t 

Hi 

H: 

=  H- 

Ht 

0 

3 

21 

H  + 

Hi 

H  + 

H: 

=  Hi 

H-t 

o 

3 

0  0 
J_  A- 

Hi 

m 

Hi 

H: 

=  Hi 

Ht 

o 

3 

23 

Li 

Hi 

Hi 

H 

=  Hi 

H+ 

0 

o 

3 

24 

L* 

L-t 

Hi 

H; 

■  H+  Ht 

X 

25 

Hi 

Ht 

Li 

H- 

Hi 

H-t 

o 

o 

3 

26 

Hi 

Hi 

Li 

H- 

Hi  ii+ 

3 

27 

H* 

L» 

Ht 

Li  Hi 

H-t 

o 

o 

3 

28 

H* 

Li 

Hi 

Hi  Hi  Hi 

o 

3 

29 

L* 

Hi 

Hi 

Li  Hi 

H-t 

3 

30 

Hi 

Li 

Hi 

H- 

Hi 

Mt 

u 

o 

3 

31 

Hi 

Hi 

Li 

H+  Hi  H-t 

o 

<> 

<X 

32 

Li 

Hi 

Li 

Hi  Hi  H* 

3 

33 

H* 

U 

Hi 

H+  Hi 

H-t 

o 

3 

34 

Li 

Li 

Hi 

Hi  Hi 

Ht 

n 

0 

<X 

35 

L* 

Ht 

Li 

H: 

i=  Hi 

Hr 

o 

3 

36 

L* 

Li 

Hi 

Hi  Hi 

H-t 

O 

3 

37 

L+ 

U 

Li 

Hi  Hi 

Hi 

o 

3 

38 

H+ 

Ht 

Ht 

H- 

-  Li 

H* 

O 

3 

39 

H  + 

Ht 

H  + 

L 

1  Hi 

Hi 

o 

<> 

<.t 

40 

H  + 

Hi 

Hi 

H 

i  H: 

Hi 

O 

3 

41 

Hi 

Hi 

Hi 

H 

i  H: 

Hi 

o 

3 

42 

L* 

Hi 

H  + 

H 

-  L- 

H:T- 

o 

o _ 

3 

43 

Li 

H't 

H+ 

L 

i  Hi 

Hi 

63 


64 


o 

0 

o 

3 

44 

L* 

Ht 

Mt 

Mt 

Ht 

Ht 

o 

a 

45 

L* 

Ht 

H* 

M- 

H- 

Ht 

o 

a 

46 

M  + 

Ht 

L* 

Mt 

H- 

Ht 

o 

47 

L* 

Ht 

M* 

H* 

H- 

Ht 

o 

a 

48 

M+ 

L* 

H* 

Mt 

H- 

Ht 

o 

a 

4? 

tit 

Ht 

Lt 

Ht 

H- 

Ht 

o 

a 

50 

L* 

Ht 

Lt 

Ht 

H- 

Ht 

o 

a 

51 

L* 

Lt 

Ht 

H* 

Lt 

Ht 

o 

a 

52 

M  + 

Ht 

Lt 

L* 

Ht 

Ht 

o 

o 

a 

53 

M  + 

Lt 

M+ 

Lt 

Ht 

Ht 

o 

a 

54 

M+ 

L* 

Mt 

Mt 

Ht 

Ht 

o 

a 

55 

Mt 

Lt 

Mt 

H* 

Ht 

Ht 

o 

a 

56 

M* 

L* 

m 

L* 

Ht 

Ht 

o 

a 

57 

L* 

Ht 

Ht 

Lt 

Ht 

Ht 

r\ 

a 

58 

L  + 

Mt 

L* 

Mt 

Ht 

Ht 

u 

r\ 

a 

5? 

L* 

Ht 

Lt 

Mt 

Ht 

Ht 

o 

kJ 

a 

60 

L* 

Mt 

L* 

Ht 

Ht 

Ht 

o 

a 

61 

L* 

Mt 

L* 

Mt 

Ht 

Ht 

o 

a 

62 

L+ 

Lt 

Mt 

M* 

H  + 

Ht 

o 

a 

63 

L* 

Lt 

Mt 

Ht 

Ht 

Ht 

o 

a 

64 

L* 

L* 

Ht 

Ht 

Ht 

Ht 

o 

a 

65 

L+ 

L* 

L* 

Ht 

Ht 

Ht 

o 

a 

66 

M* 

Mt 

L* 

Lt 

Ht 

Ht 

o 

a 

67 

L* 

Ht 

L* 

Lt 

Ht 

Ht 

o 

a 

68 

L* 

L* 

H* 

Lt 

Ht 

Ht 

o 

a 

69 

L  + 

L* 

Lt 

Ht 

Ht 

Ht 

o 

a 

1 

3 

0. 

1C 

2. 

4. 

0 

a 

9 

3 

0. 

1 

.  0.25 

0.50 

0 

a 

3 

3 

0. 

1 

.  0.05 

0.10 

o 

o 

a 

4 

1 

0. 

1 

.  0.20 

0.40 

o 

a 

5 

1 

0. 

1 

.  0.20 

0.40 

o 

a 

6 

1 

0. 

1 

.  0.33 

0.67 

o 

a 

o 

EBIT 

o 

o 

0 

0 

o 

o 

o 

o 

o 

o 

_o _ 

o 
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After  all  of  the  data  records  have  been  entered,  you  should  list  the  entire 
file  and  check  for  typing  errors. 
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o 

't  TOP 

O 

o 

$  P  100 

O 

.NULL. 
OOOOI : 

A 

O 

o 

00002: 

69 

00003: 

1 

Ht 

H+ 

H+ 

Ht 

Lt 

Lt 

O 

o 

00004: 

0 

4m 

L* 

Ht- 

H+ 

Ht 

Lt 

Lt 

00005: 

3 

L* 

H* 

Ht 

Ht 

Lt 

Lt 

o 

o 

00006: 

4 

H* 

H* 

Lt 

Ht 

H+ 

Lt 

00007: 

5 

L  + 

H* 

Ht 

Ht 

Ht 

Lt 

o 

o 

00008: 

6 

H  + 

M+ 

H+ 

H- 

Ht 

Lt 

00009: 

7 

L* 

H* 

H+ 

H- 

Ht 

Lt 

0 

o 

OOOIO: 

8 

L* 

M* 

Ht 

H- 

Ht 

Lt 

00011: 

9 

L* 

n* 

Ht 

Ht 

Ht 

Lt 

o 

00012: 

10 

H* 

L* 

Ht 

Ht 

Ht 

Lt 

o 

00013: 

11 

H* 

H* 

Lt 

Ht 

Ht 

Lt 

o 

00014: 

12 

H* 

H* 

Lt 

Ht 

Ht 

Lt 

o 

00015: 

13 

H* 

L* 

Ht 

Ht 

Ht 

Lt 

o 

00016: 

14 

H* 

L+ 

Ht 

Ht 

Ht 

Lt 

o 

00017: 

15 

H* 

M  + 

Lt 

Ht 

Lt 

Ht 

o 

00018: 

16 

H* 

M* 

L* 

Ht 

Ht 

Ht 

o 

00019: 

17 

m 

Ht 

Lt 

Ht 

H- 

Ht 

o 

00020: 

18 

H* 

Lt 

H  + 

Ht 

H- 

Ht 

o 

00021  : 

19 

L* 

nt 

Ht 

Ht 

Lt 

Ht 

o 

00022: 

20 

H* 

Lt 

Ht 

Ht 

H- 

Ht 

0 

00023: 

21 

Ht 

Ht 

Ht 

Ht 

Ht 

Ht 

00024: 

22 

H* 

Ht 

Ht 

Ht 

Ht 

Ht 

o 

o 

00025: 

23 

L* 

Ht 

Ht 

Ht 

Ht 

Ht 

00026: 

24 

L* 

Lt 

Ht 

Ht 

Ht 

Ht 

0 

o 

00027: 

25 

H* 

M  + 

Lt 

H- 

Ht 

Ht 

00028: 

26 

H* 

Ht 

Lt 

H- 

Ht 

Ht 

o 

00029: 

27 

H* 

Lt 

Ht 

Lt 

Ht 

Ht 

o 

00030: 

28 

H* 

Lt 

Ht 

Ht 

Ht 

Ht 

o 

00031  : 

29 

L* 

Ht 

Ht 

Lt 

Ht 

Ht 

0 

00032: 

30 

H* 

Lt 

Ht 

H- 

Ht 

Ht 

o 

00033: 

31 

H* 

Ht 

Lt 

Ht 

Ht 

Ht 

o 

00034: 

32 

L* 

Ht 

Lt 

Ht 

Ht 

H* 

o 

00035: 

33 

H* 

Lt 

Ht 

Ht 

Ht 

Ht 

o 

00036: 

34 

L* 

Lt 

Ht 

Ht 

Ht 

Ht 

o 

00037: 

35 

L  # 

H  + 

Lt 

Ht 

Ht 

Ht 

o 

00038: 

36 

L* 

Lt 

Ht 

Ht 

Ht 

Ht 

o 

00039: 

37 

L  + 

Lt 

Lt 

Ht 

Ht 

Ht 

o 

00040: 

38 

Ht 

H+ 

Ht 

H- 

Lt 

H* 

o 

00041  : 

39 

Ht 

H+ 

Ht 

Lt 

Ht 

H* 

0 

00042: 

40 

H  + 

Ht 

Ht 

Ht 

Ht 

H* 

00043: 

41 

H* 

Ht 

Ht 

Ht 

Ht 

Ht 

o 

o 

00044: 

42 

L* 

Ht 

Ht 

H- 

Lt 

H* 

00045: 

43 

L* 

Ht 

Ht 

Lt 

Ht 

Ht 

o 

o 

_o__ 

o 
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If  you  are  satisfied  with  the  contents  of  the  file»  type 
FILE  SUMIF9 

to  save  the  data  in  file  SUMIF9  and  to  exit  the  text  editor. 
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o 

o 

o 

o 

o 

n 


o 

00046: 

44 

L* 

H* 

M* 

it* 

H* 

H* 

o 

00047: 

45 

L* 

M* 

H* 

fl¬ 

H- 

H* 

00048: 

46 

h  + 

H* 

L* 

it* 

il- 

H* 

o 

00049: 

47 

L* 

M* 

H* 

M* 

H- 

H* 

00050: 

48 

M+ 

L* 

H* 

M* 

H- 

14* 

o 

00051 

49 

M+ 

ft* 

L* 

H* 

H- 

H* 

00052: 

50 

L* 

H* 

L* 

H* 

M- 

H* 

o 

00053: 

51 

L* 

L* 

H* 

H* 

L:* 

li¬ 

00054: 

52 

M  + 

H* 

L* 

L* 

it* 

lt* 

o 

00055: 

53 

h  + 

L+ 

M  + 

L* 

It* 

H* 

00056. 

54 

M  + 

1  ;!• 

t-  ’»■ 

H* 

M* 

H* 

14* 

o 

00057 

55 

H* 

L* 

H* 

H* 

it* 

H* 

00058 

56 

K* 

L* 

M* 

L* 

H* 

H* 

o 

00059 

57 

L* 

M* 

H* 

L* 

it* 

14* 

00060 

58 

L  + 

M* 

L* 

n* 

H* 

14* 

o 

00061 

59 

L* 

H* 

l* 

H* 

it* 

H* 

00062 

60 

L* 

it* 

L* 

H* 

it* 

14* 

o 

00063 

61 

L* 

H* 

L* 

H* 

H* 

It* 

00064 

62 

L* 

L* 

ft* 

M* 

H  + 

H* 

o 

00065 

63 

L* 

L* 

M* 

H* 

it* 

14* 

o 

00066 

64 

L* 

L* 

H* 

M* 

It* 

It* 

00067 

65 

L  + 

L* 

L* 

H* 

it* 

H* 

o 

00063 

66 

h* 

«* 

L* 

L* 

H* 

It* 

00069 

67 

L* 

H* 

L* 

L* 

H* 

H:* 

o 

00070 

68 

L* 

L* 

H* 

L* 

H:* 

H  * 

00071 

69 

L  + 

L:* 

L* 

M* 

H* 

H* 

o 

00072 

1 

3 

0. 

10.  2. 

4. 

00073 

2 

3 

0. 

1.  0.25 

0.50 

o 

00074 

3 

3 

0. 

1.  0.05 

0.10 

00075 

4 

1 

0. 

1.  0.20 

0.40 

o 

00076 

5 

1 

0. 

1.  0.20 

0.40 

00077 

6 

1 

0. 

1.  0.33 

0.67 

o 

BOTTOM 

$  FIL 

8  SUM IF 

0 

/ 

O 

O 

O 

O 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 
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3.2.4.  Pile  Maintenance.  The  two  principal  files  used  with  the  SUMMET  I 
program  are  the  input  file  SUMIF5  and  the  output  file  SUM0F6.  in  the  course 
of  doing  many  project  evaluations,  you  may  wish  to  make  revisions  to  the  input 
file  SUMIF5  and  still  retain  the  original  data  in  that  file,  you  can  rename  a 
file  in  your  user  directory  by  typing 
CNAME  SUMIF5  SUMIF5. REVO 

This  adds  the  suffix  ".REVO"  to  the  current  file  name.  This  suffix  is  of 
course  completely  arbitrary. 

The  general  syntax  for  this  command  is 
CNAME  oldfilename  newfilename 

When  you  change  the  name  of  the  input  file,  you  may  also  wish  to  save  the 
corresponding  output  file,  as  shown  in  the  example. 

Occasionally  your  user  directory  will  become  filled  with  files  you  no  longer 
want  or  even  remember  what  they  are.  In  this  case  you  can  delete  them  by 
typing 

DELETE  filename 

A  log  of  the  data  files  in  your  user  directory  is  a  handy  way  of  remembering 
the  importance  of  each  data  file. 

At  some  point  you  will  surely  forget  the  name  of  some  essential  file  in  your 
user  directory.  You  may  get  a  list  of  all  of  the  files  in  your  user  directory 
by  typing 
LISTF 
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\ 


o 

o 

o 

OK,  CNAME  SUHIF5  SUHIF5 

.REVO 

o 

OK,  CNAME  SUM0F6  SUHOFA 

.REVO 

o 

OK, 

o 

o 

o 

o 

o 

© 

o 

o 

o 

o 

o 

o 

o 

o 

OK,  DELETE  SUMSS1A 

OK,  DELETE  SUHS81B 

o 

o 

OK,  DELETE  SUMSS1C 

OK, 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

OK,  LIST!" 

o 

o 

o 

o 

U F  D  =  <  D R  A  S 1 2  >  G I L  L  E  5  20 

OUNER 

o 

o 

SUNQ  HEUR.PGH 

H EUR. PL 6  HEUR.JAH  ZSS.HEUR 

o 

HEUR.DU1  SUMH 

SU'fiD  SUHIF9  B  SUHSF  HSUHEX  L.SUMSF  SUMB1 

o 

SUHOUT 1  SUHIF5  SUH0F6 
OK, 

SUHSF. BACKUP 

o 

o 

o 

o 

o 

o 

o 

o 

o 
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3.2.5.  Execute  SUMMET  I.  The  SUMMET  I  program  has  been  compliled  and  linked 
with  the  necessary  system  subroutines  to  form  an  executable  module  or  SEGMENT. 

You  may  execute  the  SUMMET  I  program  by  typing 
SEG  fSUMEX 

Depending  on  the  number  of  projects  that  you  are  evaluating  and  the  overall 
system  load,  it  may  take  several  minutes  before  the  PRIME  responds  with 
****  STOP 

and  returns  the  command  level  prompt  "OK,".  All  of  the  program  output  goes  to 
an  output  file  named  SUM0F6 . 
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3.2.6.  Review  SUMMET  I  Output  File  SUMOF6.  You  may  examine  the  SUMMET  I 
output  file  SUM0F6  by  typing 
ED  SUM0F6 

This  puts  you  in  the  text  editor,  ready  to  list  the  contents  of  SUM0F6.  You 
can  begin  listing  the  contents  of  SUM0F6  by  typing 
P  1000 

This  will  list  the  first  1000  lines  (or  less)  of  output.  Note  that  if  there 
is  a  digit  1  immediately  following  the  colon  it  will  cause  a  page  eject  when 
the  file  is  output  to  a  line  printer. 

This  example  is  a  listing  of  the  Decision  Heuristics  input  from  SUMIF9 . 
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o 

o 


o 

o 


OK,  ED  SUM0F6 
EDIT 

1  P  1000 
O  .NULL. 


O 

O 


00001 : 1  NUMBER  OF  DECISION  DIMENSIONS 
00002:  NUMBER  OF  DECESION  HEURISTICS 
00003: 

00004: 


00005 


DECISION  HEURISTICS: 


6 
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o 

00006 

00007 

1 

Mt 

M+ 

M  + 

H* 

L  + 

L+ 

o 

00008 

2 

L* 

H* 

H+ 

Ht 

L+ 

L+ 

00009 

3 

L* 

Mt 

Ht 

Ht 

L+ 

L  + 

o 

00010 

4 

Ht 

Ht 

Lt 

Ht 

M  + 

L+ 

0001  1 

5 

L* 

M* 

Ht 

Ht 

M+ 

L  + 

o 

00012 

6 

M+ 

M+ 

H+ 

M- 

Ht 

Lt 

00013 

-i 

/ 

L* 

Ht 

M+ 

H- 

Ht 

L+ 

o 

00014 

8 

L* 

Mt 

Ht 

H- 

Ht 

L  + 

00015 

9 

L* 

Mt 

H* 

M* 

H* 

Lt 

o 

00016 

10 

H* 

Lt 

H» 

M+ 

H* 

Lt 

00017 

11 

Ht 

h* 

L* 

Ht 

Ht 

L+ 

o 

00018 

12 

H* 

Ht 

l* 

Ht 

Ht 

L  + 

00019 

13 

Ht 

Lt 

H* 

Ht 

Ht 

Lt 

00020 

14 

Mt 

Lt 

Ht 

Ht 

Ht 

L+ 

o 

00021 

15 

H* 

M+ 

L* 

H* 

Lt 

M+ 

00022 

16 

H* 

Mt 

Lt 

H* 

Ht 

Mt 

o 

00023 

17 

Mt 

H* 

Lt 

H* 

M- 

H+ 

00024 

18 

Ht 

Lt 

H+ 

Ht 

N~ 

H+ 

0 

00025 

19 

Lt 

Mt 

H* 

H* 

Lt 

Mt 

00026 

20 

Mt 

Lt 

H* 

Ht 

M- 

M+ 

o 

00027 

21 

H+ 

Ht 

H+ 

Ht 

Mt 

H+ 

00028 

22 

Ht 

Mt 

Ht 

Mt 

Ht 

Mt 

o 

00029 

23 

L* 

Ht 

Ht 

Mt 

Ht 

Mt 

00030 

24 

Lt 

Lt 

Ht 

Ht 

M+ 

H+ 

o 

00031 

25 

Ht 

M+ 

Lt 

M- 

Ht 

Ht 

00032 

26 

Mt 

Ht 

Lt 

M- 

Ht 

Mt 

o 

00033 

27 

Ht 

L* 

M  + 

L* 

Ht 

H-t 

00034 

28 

Ht 

Lt 

»t 

Mt 

Ht 

H+ 

o 

00035 

29 

L* 

Ht 

Ht 

Lt 

Ht 

Mt 

00036 

30 

Mt 

Lt 

Ht 

H~ 

Ht 

Mt 

o 

00037 

31 

Ht 

Mt 

Lt 

M+ 

Ht 

M+ 

00038 

32 

Lt 

Ht 

Lt 

ii* 

Ht 

Ht 

00039 

33 

M* 

Lt 

Mt 

H+ 

Ht 

H  + 

o 

00040 

34 

Lt 

Lt 

Ht 

Mt 

Ht 

H+ 

00041 

35 

Lt 

M  + 

Ll: 

Ht 

Ht 

Mt 

o 

00042 

36 

Lt 

Lt 

Mt 

Ht 

Ht 

M+ 

00043 

37 

L+ 

Lt 

Lt 

Ht 

Ht 

Ht 

o 

00044 

38 

H+ 

M  + 

H+ 

M- 

Lt 

Ht 

00045 

39 

M  + 

H+ 

M+ 

L* 

Ht 

Ht 

O 

O 

O 

O 

O 

O 

o 

o 

o 

O 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 


o 


This  is  a  listing  of  the  Utility  Functions  also  input  from  SUMIF9. 
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o 

00046: 

40 

Mr  H* 

H* 

H:r 

Mi 

Hi 

O 

00047: 

41 

H*  M* 

Hr 

Mi 

Hi 

Hi 

o 

00048: 

42 

L*  H* 

H+ 

M- 

Li 

Hi 

O 

00049: 

43 

L*  H* 

H  + 

L* 

Mi 

H 

o 

00050: 

44 

Li  H* 

Hi 

Hi 

Mi 

H:i 

O 

00051  : 

45 

L  *  M  * 

H:r 

M- 

H- 

Hi 

o 

00052: 

46 

M  +  Hi 

L* 

Hi 

M- 

Hi 

o 

00053: 

47 

L*  Hi 

Hi 

Hi 

M- 

Hi 

0 

0 

00054: 

48 

fir  L* 

Hi 

M* 

H-- 

Hi 

o 

00055: 

49 

N*  H* 

L* 

H* 

M~ 

Hi 

o 

00056: 

50 

L*  H* 

L* 

Hi 

M- 

Hi 

o 

00057: 

1  NUMBER 

OF  DECISI 

ON 

HI  HENS  IONS 

o 

o 

00058: 

NUMBER 

OF  BECE3IQS 

HEURISTICS 

=  (69 

o 

00059: 
00060 ; 

o 

o 

00061  : 

HE CI SI  ON  HEURISTICS 

: 

o 

00062 o 

00063 « 

r  •« 

V*  i 

L*  Li 

H* 

Hi 

Li 

Hi 

o 

o 

00064: 

52 

B+  H* 

L* 

Li 

Mi 

Hi 

o 

00065: 

53 

M+  L* 

Hr 

L* 

Hi 

Hi 

o 

00066 : 

54 

M  +  L* 

M* 

Hi 

Mi 

Hi 

o 

00067: 

55 

Hi  L* 

M* 

Hi 

Hi 

Hi 

o 

00068: 

56 

H i  L  * 

H  -r 

L* 

Hi 

Hi 

o 

00069: 

57 

L*  Hi 

Mi 

Li 

Mi 

Hi 

o 

00070: 

58 

L+  Mi 

L* 

Hi 

Mi 

Hi 

o 

00071  : 

5? 

L*  H* 

L* 

M* 

Hi 

Hi 

o 

00072: 

60 

L*  Hi 

L* 

Hi 

Hi 

Hi 

0 

o 

00073: 

61 

L*  Hi 

L* 

Hi 

Hi 

Hi 

o 

00074: 

62 

Li  L* 

H* 

Mi 

Hi 

Hi 

o 

00075: 

63 

L*  L'r 

H* 

H* 

rt  :i- 

Hi 

o 

00076: 

64 

L*  L* 

Ht 

il* 

Mi 

Hi 

o 

00077: 

65 

L+  L* 

L* 

Hi 

Mi 

Hi 

o 

00078: 

66 

H*  H* 

Li 

Li 

Hi 

Hi 

o 

00079: 

67 

L*  Hr 

Lt 

Li 

Hi 

Hi 

o 

00080: 

68 

Li  L* 

H* 

Li 

Hi 

Hi 

o 

00081  : 

6? 

L+  Li 

L* 

Mi 

Hi 

Hi 

o 

00082: 

1 UTILIT1 

FUNCTIONS 

o 

00083: 

o 

00084: 

DECISION  DIMENSION 

1 

o 

00085: 
00086 : 

LO 

HI 

o 

o 

00087: 

0.00 

10.00 

o 

00088: 

INDEX 

UTIL. 

PAR 

o 

00089: 

1 

3.00  2 

.00 

o 

00090: 

n 

i. 

2.00  A 

.00 

o 

00091 :: 

3 

1.00  10 

.00 

o 

o 

00092: 

77 
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o 

o 

000?3 : 

DECISION  DIMENSION 

0 

o 

00094 s 
00095: 

LG  HI 

o 

o 

o 

00096 : 

0.00  1.90 

00097; 

INDEX  UTIL 

FAR 

o 

o 

00098s 

1  3.00 

0.25 

o 

00099: 

2  2.00 

0.50 

o 

00100s 
00101 : 

3  1.00 

1.00 

o 

o 

00102s 

DECISION  DIMENSION 

3 

o 

00103s 

00104: 

LQ  HI 

o 

o 

00105s 

0.00  1.00 

o 

00106: 

INDEX  UTIL 

PAR 

o 

00107; 

1  3.00 

0.05 

o 

00108: 

2  2.00 

0.10 

o 

00109s 

3  1 .00 

1 .  oo 

o 

0 0 1 10: 
0011 1 s 
00112s 

DECISION  D I MENS 

ION 

4 

o 

o 

o 

00113: 

LO  HI 

o 

00114s 

0.00  1.00 

o 

o 

00115s 

INDEX  UTIL 

PAR 

001 14: 

1  1  .00 

0 . 20 

o 

o 

001 17: 

2  2.00 

0.40 

00118s 

3  3.00 

1.00 

o 

o 

00119: 

00120: 

DECISION  DIHENS 

ION 

C 

J 

0 

o 

00121 s 

o 

00122s 

00123; 

LO  HI 

0.00  1 .00 

o 

o 

00124; 

00125: 

INDEX  UTIL 

1  1  .00 

PAR 

0.20 

o 

o 

00126: 

2  2.00 

0.40 

o 

00127; 

3  3.00 

1.00 

o 

00123: 

00129s 

DECISION  DIHENS 

ION 

6 

o 

o 

00130: 
00131  s 

LO  HI 

0 

o 

00132: 

0.00  1.00 

o 

00133: 

INDEX  UTIL 

PAR 

o 

o 

00134: 

1  1.00 

0 . 33 

00135: 

2  2.00 

0.67 

o 

o 

00136; 

3  3.00 

1.00 

o 

o 

79 


This  example  is  a  listing  of  distributions  input  for  the  characteristic 
parameter  for  each  Decision-Dimension  from  SUMIF5. 


This  is  the  Utility  Likelihood  Table  that  results  from  the  convolution  of  the 
utility  functions  and  the  characteristic  parameter  distributions. 
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o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 


00137:1  THREAT  WARNING  /  REACTION  S 
00138: 

00139:  DECISION  DIMENSION  1 
00140: 

00141:  BETA  DISTRIBUTION  TYPE  5 
00142:  MIN  MOD  MAX 

00143:  1.00  0.00  3.00 

00144: 

00145:  DECISION  DIMENSION  2 
00146: 

00147:  HISTOGRAM  DISTRIBUTION  UITH 
00148:  SEG  LBD  UBD  DEN 

00149:  1  0.10  0.30  1.00 

00150: 

00151:  DECISION  DIMENSION  3 
00152: 

00153:  BETA  DISTRIBUTION  TYPE  5 
00154:  MIN  MOD  MAX 

00155:  0.03  0.00  0.06 

00154: 

00157:  DECISION  DIMENSION  4 
00158: 

00159:  HISTOGRAM  DISTRIBUTION  UITH 


00160: 

SEG 

LBD 

UBD 

DEN 

00161: 

1 

0.00 

0.20 

0.20 

00162: 

2 

0.20 

0.40 

0.30 

00163: 

3 

0.40 

0.60 

0.40 

00164: 

4 

0.60 

0.80 

0.10 

00165: 

00164: 

DECIS 

ION  DIMENSION 

5 

00167: 

00168; 

HISTOGRAM  DISTRIBUTION  UITH 

00169: 

SEG 

LBD 

UBD 

DEN 

00170: 

1 

0.00 

0.20 

0.20 

00171 : 

2 

0.20 

0.40 

0.70 

00172: 

3 

0.60 

0.80 

0.10 

00173: 

00174: 

DECIS 

ION  DIMENSION 

6 

00175: 


1  SEGMENTS 


4  SEGMENTS 


3  SEGMENTS 


00176:  DISCRETE  DISTRIBUTION  AT  0.71 


00177: 


00178:  UTILITY  LIKELIHOOD  TABLE 


00179: 

DIM 

LOW 

MEDIUM 

HIGH 

00180: 

1 

0.0000 

0.5001 

0.4999 

00181: 

2 

0.0000 

0.2500 

0.7500 

00182: 

3 

0.0000 

0.1919 

0.8081 

00183: 

4 

0.2000 

0.3000 

0.5000 

00184: 

5 

0.2000 

0.7000 

0.1000 

00185: 

6 

0.0000 

0.1000 

0.9000 

n 


O 

O 

O 

O 

o 

o 

o 

o 

o 

O 

O 

O 

O 

O 

O 

O 

O 

O 

o 

o 

o’ 

o 

o 

o 

o 
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Following  is  the  go  likelihood  contribution  of  each  of  the  Decision  Heuristics. 


Also  listed  is  the  resultant  go  likelihood  for  this  project. 


o 


o 


o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 


0  0186:' 

1  THRE 

:at  warning  , 

/  REACTION  3 

00187: 

LIKE  1. 

_ I MOO 5 

CONTRIBUTION 

OF  RULES 

00138: 
001 89s 

i 

0.5000 

o 

0.0000 

”7 

-.3 

0.0000 

4 

0.0000 

r 

•J 

0.0000 

00190: 

6 

0.0500 

7 

0.0000 

q 

u 

0.0000 

n 

0.0000 

10 

0.00(50 

00191 : 

1  1 

0.0000 

i  n 

t  £. 

0.0000 

13 

0.0000 

14 

0.0000 

15 

0.0000 

00192: 

1  L 

i  0 

0.0000 

17 

0.0000 

18 

0.0000 

19 

0.0000 

20 

0.0000 

00193; 

21 

0.1575 

9? 

0.0212 

23 

0.0000 

24 

0.0000 

25 

0.0000 

00194: 

26 

0.0000 

^  / 

0.0000 

9  0 

£.  \J 

0.0000 

?9 

0.0000 

30 

0.0000 

00195: 

31 

0.0000 

32 

0.0000 

33 

0.0000 

34 

0 . 000 0 

"7  1.7 

\j-.J 

0.0000 

00196: 

36 

0.0000 

37 

0.0000 

38 

0.0900 

3? 

0.1260 

40 

0.0091 

00197: 

41 

0.0191 

42 

0 .0000 

43 

0.0000 

44 

0.0000 

45 

0 . oooo 

00193: 

46 

0.0000 

47 

0.0000 

48 

0.0000 

49 

0.0000 

50 

0.0000 

00199: 

51 

0.0000 

52 

0.0000 

53 

0.0000 

54 

9.0000 

55 

0.0000 

00200: 

56 

0.0000 

e  ~f 
j/ 

0.0000 

53 

0.0000 

59 

0.0000 

60 

0.0000 

00201 : 

61 

0.0000 

62 

0.0000 

63 

0.0000 

64 

0.0000 

65 

0.0000 

00202: 

00203: 

(j  u 

0.0000 

L  1 

u  t 

0.0000 

63 

0.0000 

69 

0.0000 

00204: 

•'GO"’ 

LIKELIHOOD 

=  0.972* 

9  FOR 

THREAT 

DARN  INS  / 

REACT] 

[ON  S 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 
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Each  of  the  projects  is  treated  in  the  same  fashion  as  the  first. 
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o 


00205:1  IR  SUPPRESSOR  -  LOU  RISK 
00206: 


O 


00207: 

DECISION  DIMENSION  1 

o 

00208: 

00209: 

BETA  DISTRIBUTION  TYPE  7 

O 

o 

00210: 

HIM  MOD  MAX 

O 

0021  1 : 

1.00  0.00  2.50 

o 

00212; 

00213; 

DECISION  DIMENSION  2 

0 

o 

00214: 

00215; 

DISCRETE  DISTRIBUTION  AT  0.13 

o 

o 

00216: 

o 

o 

00217: 

DECISION  DIMENSION  3 

o 

00213; 

.  00219: 

BETA  DISTRIBUTION  TYPE  7 

o 

o 

00220: 
00221 : 

MIN  MOD  '  MAX 

0.01  0.00  0.01 

o 

o 

00222: 

o 

00223: 

00224; 

DECISION  DIMENSION  4 

o 

o 

00225; 

HISTOGRAM  DISTRIBUTION  UITH  3  SEGMENTS 

o 

00226: 

SEG  LBD  UBD  DEN 

o 

00227: 

1  0.00  0.20  0.60 

0 

00223: 

2  0.20  0.40  0.20 

o 

QO'Ti'JO. 

00230: 

3  0.40  0.60  0.20 

o 

o 

00231  : 

DECISION  DIMENSION  5 

o 

00232: 

O  00233: 

00234: 

O  00235; 

00236: 

O  00237: 

00238:  DECISION  DIMENSION 


HISTOGRAM  DISTRIBUTION  UITH  2  SEGMENTS 
SEG  LBD  UBD  DEN 

1  0.00  0.20  0.75 

2  0.40  0.60  0.25 


o 

00239: 

o 

00240: 
00241  : 

DISCR 

ETE  DISTRI 

BUTTON  AT 

0.40 

o 

00242: 

UTILITY  LIKELIHOOD  TABLE 

00243: 

DIM 

LOU 

MEDIUM 

HIGH 

o 

00244: 

1 

0.0000 

0 .601 4 

0.3986 

00245: 

n 

0.0000 

0.0000 

1  .0000 

o 

00246: 

3 

0.0000 

0.0000 

1.0000 

00247: 

4 

0 . 6000 

0.2000 

0.2000 

o 

00243: 

c 

•J 

0.7500 

0.0000 

0.2500 

00249: 

6 

0.0000 

1 .0000 

0.0000 

O 


o 

o 

o 

o 

o 

o 

o 

o 

o 

o 
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86 


o 


o 


o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 


00250:' 

1  IR 

SUPPRESSOR 

- 

LOU  RISK 

o 

00251 : 

LIKE 

LI  HOOD  COSTR 

I  BUT  ION  0 

F  RULES 

00252: 

o 

00253: 

1 

0.2000 

0.0000 

•7 

0.0000 

4 

0.0000 

5 

o .  OOOO 

00254: 

6 

0.2000 

“I 

/ 

0 . 0000 

8 

0.0000 

9 

0.0000 

10 

0 . 00(50 

o 

00255: 

1 1 

0.0000 

12 

0.0000 

13 

0.0000 

14 

0.0000 

15 

0.0000 

00256: 

16 

0.0000 

17 

0.0000 

18 

0.0000 

■t  n 
i  ! 

0 .  oooo 

O  A 

0.0000 

o 

00257: 

21 

0.0000 

o'y 

0 . 0000 

c  *.j 

0.0000 

24 

0.0000 

•")  c 

0  „  oooo 

o 

00253: 

26 

0.0000 

£.  i 

0.0000 

28 

0.0000 

29 

0.0000 

30 

0.0(500 

00259: 

31 

0.0000 

~t  n 

•j  i. 

0.0000 

33 

0.0000 

34 

0.0000 

i:r 

O-J 

0.0000 

o 

00260: 

36 

0.0000 

37 

0.0000 

38 

0.0000 

39 

0.0000 

40 

0.0000 

00261  : 

41 

0.0000 

42 

0.0000 

43 

0.0000 

44 

0 ..  0  00  0 

45 

o „ oooo 

o 

00262: 

46 

0.0000 

47 

0.0000 

48 

0.0000 

49 

0 . 0  0  0  0 

50 

0.0000 

00263: 

51 

0.0000 

52 

0.0000 

53 

0.0000 

54 

0.0000 

55 

0.0000 

o 

00264: 

56 

0.0000 

57 

0.0000 

58 

0.0000  ' 

5? 

0.0000 

60 

0.0000 

00265: 

61 

0 . 0000 

62 

0.0000 

63 

0.0000 

64 

U .OOOO 

65 

0.0000 

o 

00266: 

00267: 

66 

0.00  0  0 

67 

0.0000 

6  3 

0.0000 

69 

0.0000 

o 

00268: 

•"GO"' 

LIKELIHOOD 

=  0.4000 

FOR 

IR  SUPP 

RE SB OR  -  LOU 

Rl: 

t:  u 

o 


o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 
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88 


00273s  BETA  DISTRIBUTION  TYPE  ? 

00274:  HIM  MOB  MAX 

00275:  1.00  0.00  2.50 
00276: 

00277;  DECISION  DIMENSION  2 
00278: 

00279:  DISCRETE  DISTRIBUTION  AT  0.60 
00280: 

002(31  :  DECISION  DIMENSION  3 
002(32: 


00293; 

BETA  BIS 

TR I BUT I ON  TYPE 

7 

00284: 

HIM 

MOD 

MAX 

00285: 

0.03 

0.00 

0 , 06 

002(36: 

002(37 

DECISION 

DIME 

NS I  DM  4 

00288s 

00289: 

HISTQGRA 

M  BIS 

TSU  BUTTON 

WITH 

00290: 

ecu 

LBD 

USD  B 

E  N 

00291  : 

1  0 

.00 

0 . 20  0 . 

20 

00292: 

2  0 

.20 

0.40  0. 

40 

00293: 

3  0 

.40 

0.60  0. 

40 

00294: 

00295:  DECISION  DIMENSION  5 
00296: 

00297:  HISTOGRAM  DISTRIBUTION  WITH  3  SEGMENTS 


00298: 

SEG 

LBD 

IJBD  BEN 

00299: 

1 

0.00 

0.20  0.30 

00300: 

2 

0.20 

0.40  0.40 

00301 : 
00302: 

3 

0.40 

0.60  0.30 

00303: 

00304: 

DECIS 

ION  DIMEN 

SION  6 

00305 : 
00304; 

DISCRETE  DISTRIBUTION  AT  0.40 

00307: 

UTILITY  LIKE LI 

HOOD  TABLE 

00308: 

DIM 

LOU 

MEDIUM  HIGH 

00309: 

I 

0.0000 

0.6014  0.3936 

00310: 

n 

1 .0000 

0.0000  0.0000 

0031 1  : 

•7 

o 

0.0000 

0.6014  0.3936 

00312: 

4 

0 . 2000 

0.4000  0.4000 

00313: 

C 

•j 

0.3000 

0.4000  0.3000 

(5031  4: 

.* 

O 

0.0000 

1.0000  0.0000 

O 

O 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 


When  you  have  completed  your  examination  of  the  output  file  SUM0F6,  you  type 
Q 

to  (Q)UIT  or  exit  the  text  editor.  Note  that  if  you  have  only  reviewed  the 
data  in  a  file  and  have  not  modified  it,  you  do  not  use  the  FILE  command  to 
exit  the  text  editor. 
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o 

00315:- 

1  IR 

ciiDODccenP  - 

>.jui  i  i  \  u  -.j  3  U  t  • 

HIGH  R] 

[  BK 

o 

o 

00316: 
0031  7 : 

LIKELIHOOD  GOHTR 

I  BUT  I  OH 

OF  R! 

jnrc 

o 

o 

003!  3 : 

1 

0.0000  2 

0.0000 

3 

0.0000 

4 

0.0000 

5 

0.0000 

o 

00319: 

6 

0.0000  7 

0 . 0000 

8 

0.0000 

9 

0 . 0  0  0  0 

10 

0.0381 

o 

00320: 

1 1 

0.0000  12 

0.0000 

13 

0.0238 

1 4 

0.0288 

15 

0 . 0  0  0  0 

o 

00321  : 

1  6 

0.0000  17 

0 . 0000 

i  a 

1  U 

0.1116 

19 

0.0(500 

20 

0 . 0  o  7  ! 

o 

00322: 

21 

0.0000  22 

0.0000 

23 

0.0000 

24 

0.0000 

25 

0.0000 

o 

00323: 

n  r 
cO 

0.0000  27 

0.0239 

no 

L  '.J 

0.0283 

29 

0.0000 

30 

0.0431 

o 

00324; 

31 

0.0000  32 

0.0000 

7  7 

•.J  -J 

0.0868 

34 

0.0000 

"1  c. 

\J  -J 

q.oooo 

o 

00325: 

36 

0.0000  37 

0.0000 

38 

0.0000 

39 

0.0000 

40 

0.0000 

0 

0 

00326: 

41 

0.0000  42 

0.0000 

43 

0.0000 

44 

0.0000 

45 

0.0(500 

o 

00327: 

46 

0.0000  47 

0.0000 

48 

0.0000 

49 

0.0000 

50 

0 , 0  0  0  0 

o 

00328: 

51 

0.0000  52 

0 . 0000 

53 

0 . oooo 

54 

0.0000 

55 

0.0000 

o 

00329: 

56 

0.0000  57 

0.0000 

58 

0.0000 

ir  r, 

J7 

0.0000 

60 

0.0000 

o 

00330 : 

61 

0.0000  62 

0.0000 

63 

0.0000 

64 

0.0000 

65 

0.0000 

o 

00331  : 
00332: 

66 

0.0000  67 

0.0000 

63 

0.0000 

69 

0.0000 

o 

o 

00333: 
00334  : 

•"GO"' 

LIKELIHOOD 

=  0.4570 

i  FOR 

IR  Sil? 

PRESSOR  -  HIG 

h  r:i 

51/ 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 


BOTTOM 
'i  Q 
OK, 


o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 
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After  you  have  executed  the  SUMMET  I  program,  you  may  wish  to  examine  only  the 
go  likelihoods  for  each  of  the  projects.  You  may  do  this  by  entering  the  text 
editor  as  before,  but  instead  of  using  the  (P)RINT  command,  you  type 
L  GO;* 


This  is  an  abbreviated  form  for 
(L)OCATE  string 

This  will  find  the  first  occurrence  of  the  string  "GO"  in  the  output  file. 
Using  the  suffix  will  find  all  occurrences  of  the  string  "GO". 

Note  that  the  results  are  not  sorted  from  highest  to  lowest,  but  rather  in  the 
order  in  which  they  were  evaluated. 

To  exit  the  text  editor  type 
Q 

and  return  to  the  command  level. 
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o  o 

Q  OK,  ED  SUHQFA  q 

EDIT 

O  '*  L  00  O 

0 0204:  -'GO'  LIKELIHOOD  =  0.972?  FOR  THREAT  WARNING  /  REACTION  S 

O  00263:  "G0-'  LIKELIHOOD  =  0.4000  FOR  IR  SUPPRESSOR  -  LOU  RISK  Q 

00333:  ■'GO"'  LIKELIHOOD  =  0.4570  FOR  IR  SUPPRESSOR  -  HIGH  RISK 
O  BOTTOM  O 

$  Q 

O  OK,  O 

O  O 

O  O 

o  o 

o  o 

o  o 

o  o 

o  o 

o  o 

o  o 

o  o 

o  o 

o  o 

o  o 

o  o 

o  o 

o  o 

O  O 

o  O 

o  O 
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3.2.7.  Spooling  the  Output  Pile  to  the  Printer.  After  you  have  done  a  quick 
scan  of  your  output  file,  SUM0F6,  using  the  text  editor,  you  may  wish  to  have 
a  hard  copy  of  the  entire  file,  you  can  send  your  output  file  to  a  high  speed 
printer  at  TACOM  by  typing 
SPOOL  SUM0F6  -FTN 

The  option  -FTN  tells  the  print  handler  that  the  output  file  contains  special 
characters  in  column  1  that  control  pagination  and  other  output  spacing. 
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o. 

q  OK.  SPOOL  SUHOFi  -FTN 

CSPOOL  rev  16.33 

q  PRT0C2  spooled,  records:  10 

OK,  • 

O 

O 

O 

O 

O 

O 

O 

O 

O 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 


o 

o 

nane:  SUH0F6  q 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 
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3.2.8.  Logout  Procedure.  You  logout  of  the  PRIME  computer  by  simply  typing 
LOGOUT 

when  you  are  at  the  system  command  level.  After  the  terminal  session 
statistics  have  been  printed  out,  remove  the  telephone  headset  from  the  modem 
cradle  and  hang  it  up.  your  terminal  session  is  now  complete. 
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o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 


OK,  LOGOUT 

(31  LIES  (53)  LOGGED  OUT  AT  13:50  052783 
TIME  USED*  0:01  0:01  0:01 

U  A I T _ 

Disconnected  fron  DRAB 
OK, 


O 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 
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3.3.  Reference  Material 


As  a  reference  guide  to  the  entire  SUMMET  I  program,  we  provide  here  a 
complete  program  listing  and  a  complete  set  of  sample  data  for  both  the  SUMIF5 
and  SUMIF9  data  files.  A  sample  output  that  corresponds  to  the  reference 
sample  inputs  is  also  provided. 

The  program  listing  of  SUMMET  I  is  well  commented  and  should  provide  ample 
documentation  of  the  program  code.  The  sample  inputs  are  the  same  as  were 
used  in  the  annotated  terminal  session  presentation,  and  are  adequately 
discussed  there.  The  same  is  true  for  the  reference  output.  These 
input/output  samples  are  included  here  for  completeness  of  the  reference 
section. 
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3.3.1.  Program  Listing. 


o 

i  CO 

•  rn 

Pi 

1  X 

1  r~* 

o 

o 

EDIT 

o 

*  P  1000 

o 

o 

.NULL. 

00001 : C 
00002 :  C 
00003 :  C 
00004:  C 

SUMHET  PROGRAM 

o 

o 

o 

o 

00005 : C 
00006:C 

MAIN 

o 

o 

00007: 

PARAMETER  HXRIJLE  =  100.  MXDIM  =  6,  MXDIH2  =  12 

00008: 

CHARACTER  XRFSYM*1 

o 

o 

00009: 

CHARACTER  PLUStl 

00010: 

CHARACTER  SYM*1 

o 

0001  1  : 

COMMON  / B L K 0 0 /  NRULE, NDIM 

o 

00012: 

COMMON  /BLK01  /  SYM(MXRULE,MXDIM2)  ,NIJM(MXRULEf HXD'IM) 

o 

00013: 

COMMON  /BLK02/  VAL(MXDIM,3> 

o 

00014: 

COMMON  / B L K 0 3 /  UTIL < MXDIM , 3 ) , PAR ( MXD IM , 3 ) 

o 

00015: 

COMMON  / B L K 0 4 /  BETA(9,100) ,VM0DB(9) 

o 

00016: 

COMMON  /BLK05/  HIST < MXDIM f 21 ) ,HDEN( MXDIM, 1 0) 

o 

00017: 

COMMON  /BLK06/  PL0< MXDIM) , PHI (MXDIM) 

o 

00018: 

COMMON  /BLK07/  PUT ( MXDIM) ,BTYPE ( MXDIH) , DSCRT1 MXDIM) 

o 

00019: 

00020: 

COMMON  / B L K 0 8 /  XMIN(MXBIM) ,XM0D( MXDIM ) ,XM AX (MXDTH) 

COMMON  / B L K 0 9 /  T I TLE < 8 > 

o 

o 

00021  : 

COMMON  / B L K 1 0 /  PRULE(MXRULE) 

0 

00022: 

COMMON  /BLK99/  IOD5.IOD9.IOH6 

00023: 

I0D5  =  5 

o 

o 

00024: 

I0D9  =  9 

00025: 

I0D6  =  6 

o 

o 

00026: 

OPEN ( I0D5,FILE=  'SUMIF5') 

00027: 

OPEN ( 1 0 D 9 , F I L E  =  'SUHIF9  ) 

o 

00028: 

0F'EN(I0D6,FILE=  'SUM0F6") 

o 

00029: 

RE AD ( I0D5, 1110)  INPUTC 

o 

00030:  1110 
00031  :C 

FORMAT ( 15) 

o 

o 

00032: C 
00033:  C 

INPUT  DECISION  HEURISTICS 

0 

o 

00034: 

00035 : C 

CALL  INF'UTI 

o 

o 

00036: C 
00037 : C 

INPUT  UTILITY  FUNCTIONS 

o 

o 

00038: 

00039 :C 

IF (INPUTC  .EQ.  1)  CALL  INPUT 2 

o 

00040 :C 

BEGIN  PROJECT  EVALUATION  LOOP 

0 

o 

00041  :C 
00042:  2210 

CONTINUE 

o 

o 

00043: 

REA D(I0D5, 2410, END =7000)  (TITLE! IT) ,  IT=1,7) 

00044:  2410 

FORMAT (7A4) 

o 

o 

00045: 

WRITE! I0D6.251 0)  (TITLE (IT),  IT=1,7) 

00046:  2510 

FORMAT ( 1  HI , 7  A  4 ) 

o__ 

o 

99 


o 

O 

0004? 

C 

o 

00048 

C 

INITALIZE  TABLES  FOR  NEW  PROJECT 

o 

00049 

00050 

C 

CALL  INITL 

o 

o 

00051 

C 

\ 

o 

00052 

C 

INPUT  PARAMETER  DISTRIBUTIONS 

o 

00053 

C 

AND  PERFORM  CONVOLUTIONS 

0 

00054 

00055 

C 

IF ( INPUTC  .EQ.  1)  CALL  INPUT 3 

o 

o 

00056 

C 

0 

0005? 

C 

INPUT  UTILITY  LIKELYHQOD  TABLE 

o 

0 

00058 

C 

IF  CONVOLUTIONS  ARE  NOT  CALCULATED 

0 

0005? 

00060 

C 

IF (INPUTC  .EQ.  0)  CALL  INPUTV 

0 

0 

00061 

C 

o 

00062 

C 

COMPUTE  'GO-'  LIKELYHQOD 

o 

00063 

00064 

c 

CALL  FINDGO 

o 

o 

00065' 

c 

CALL  OUTPUT 

o 

00066: 

0006?: 

c 

GOTO  2210 

o 

o 

00068: 

c 

END  OF  PROJECT  EVALUATION  LOOP 

o 

09069: 

c 

o 

00070! 

7000 

CONTINUE 

o 

00071 

CLOSE ( I0D5 ) 

o 

00072: 

CLOSE ( I0D9) 

o 

00073: 

CLOSE ( I0D6 ) 

o 

00074: 

STOP 

0 

00075: 

END 

o 

0 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

0 

o 

o 

o 

100 


o 

00076: 

SUBROUTINE  INPUT  1 

O 

o 

o 

00077  :C 
00073  :C 
00079  :C 

INPUT  DECISION  HEURISTICS 

0 

O 

00080: 

PARAMETER  MXRULE  =  100,  HXDIH  =  6,  MXDIH2  =  12 

o 

00031  : 

CHARACTER  XRFSYM*1 

O 

00082: 

CHARACTER  PLUS  + 1 

o 

00033: 

CHARACTER  MINUS*1 

0 

00034: 

CHARACTER  SYM*1 

o 

00085: 

COMMON  / B L K 0 0 /  N R U L E , N D I H 

0 

00086: 

COMMON  /BLK01  /  SYM  <  MXRULE ,  HXDIM2) ,  NUM  (MXRULE , HXBI fi ) 

o 

00087: 

COMMON  / B L K 0 3 /  UTIL(MXHIM,3) ,  PAR < MXDIM , 3 ) 

0 

00038: 

COMMON  / B L K 0 6 /  PLO(MXHIM) ,PHI (HXDIM) 

o 

00089: 

COMMON  / B L K 9 9 /  I0B5,I0B9,I0U6 

O 

00090: 

DIMENSION  XRFSYM ( 3) 

o 

00091  : 

XRFSYH  <  3 )  =  1 HH 

O 

00092: 

XRFSYM 1 2 )  =  1 HM 

o 

00093: 

XRFSYM ( 1)  =  1 HL 

o 

00094: 

PLUS  =  1H+ 

o 

00095: 

MINUS  =  1H- 

o 

00096: 

REA D (10 D 9, 3110)  NDIM 

o 

o 

00097: 

READ ( I0D9 ,3110)  N RULE 

o 

00098:  3110 
00099 sC 

FORMAT (1015) 

o 

o 

0  0 1  0  0 :  C 

0  0 1  0 1 :  C 

READ  DECISION  HEURISTICS 

o 

o 

00102: 

NDIM2  =  2  *  NDIM 

o 

00103: 

DO  3300  IR  =  1.NRULE 

o 

00104: 

00105:  3220 

READ ( I0D9 , 3220 )  IRJ , (SYM (IR. IP-1 ) , !SYM ( IR. IP ) ,  IP=2 , NDIM2 , 2 > 
FORMAT ( 13 , 1 0 ( 1 X , A1 ,A1 )) 

o 

o 

00106:  3300 

CONTINUE 

0 

001 07:  C 

0  0 1  0  3 :  C 

0  0 1  0  9 :  C 

CONVERT  SYMBOLIC  INPUT  TO  NUMERIC  EQUIVALENT 

o 

o 

o 

001 10: 

DO  3600  IR  =  1 , NRULE 

o 

001 1 1 : 

DO  3500  IP  =  1 , N D I H 

o 

00112: 

NUM I  =  0 

o 

00113: 

DO  3400  IX  =  1,3 

o 

00114: 

IF ( SYM  ( IR ,  2+IP-1  )  .NE.  XRFSYM (IX  ) )  (30  TO  3400 

o 

00115: 

NUMI  =  3  *  IX 

0 

o 

00116: 

IF (SYM( IR , 2*IP)  .EQ.  PLUS)  NUMI  =  NUMI  +  1 

00117: 

IF ( SYM ( IR , 2* IP)  .EQ.  MINUS)  NUMI  =  NUMI  -  1 

o 

o 

00118: 

NUM ( I R, IP)  =  NUMI 

00119:  3400 

CONTINUE 

o 

o 

00120:  3500 

CONTINUE 

_o _ 

00121:  3600 

CONTINUE 

__o_ 
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o 

• 

O 

o 

00122: 

00123: 

C 

c 

LIST  DECISION  HEURISTICS  TO  OUTPUT  FILE 

O 

o 

00124: 

00125: 

c 

DO  5000  IRR  =  1  , NRULE , 50 

O 

o 

00126: 

WRITE ( I0D6 , 3620 )  NDIM, NRULE 

O 

00127: 

3620 

FORMAT ( 1  HI ,  ■ '  NUMBER  OF  DECISION  DIMENSIONS  a", 15, 

o 

00128: 

*  /,•'  NUMBER  OF  DECESION  HEURISTICS  =',I5) 

o 

00129: 

WRITE ( I0D6 , 3640 ) 

o 

00130: 

3640 

FORMAT!///  DECISION  HEURISTICS:',/) 

o 

00131: 

IR1  =  IRR 

0 

o 

00132: 

IR2  =  IRR  +  49 

00133: 

IFUR2  ,GT.  NRULE)  IR2  =  NRULE 

0 

0 

00134: 

DO  4000  IR  =  IR1 , IR2 

o 

00135: 

WRITE ( I0D6 , 3720 )  IR, (8YM< IR , IP-1 ) ,SYM< IR , IP) rIP=2,N0IH2,2) 

o 

00136: 

3720 

FORMAT ( 15 , 1 0(3X, A1 ,A1 )) 

o 

00137: 

4000 

CONTINUE 

o 

00138: 

5000 

CONTINUE 

o 

00139: 

RETURN 

o 

00140: 

END 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

_  _o_ 
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o 

00141: 

SUBROUTINE  INPUT2 

O 

o 

00 1 42 : C 

001 43:C 

INPUT  UTILITY  FUNCTIONS 

o 

o 

001 44:C 
00145: 

PARAMETER  MXRULE  =  100,  MXBIM  =  A,  HXDIH2  =  12 

0 

o 

00146: 

COMMON  /BLKOO/  NRULE,NDIM 

o 

00147: 

COMMON  / B L K 0 3 /  UTIL(MXIHM,3) ,PAR(MXDIM,3) 

o 

00148: 

COMMON  / B L K 0 A /  PLQ(MXBIM) f PHI (MXDIM) 

o 

00149: 

COMMON  / B L K 9 9 /  IOD5,IOB9,IOB6 

o 

00150: 

URITE ( I0B6 ,1010) 

o 

00151:  1010 
001 52:C 

FORMAT ( 1  HI , 'UTILITY  FUNCTIONS') 

o 

o 

001 53 :  C 

0  0 1 54 :  C 

READ  UTILITY  FUNCTION  PARAMETERS 

o 

o 

00155: 

DO  2000  IP  =  1  ,NBIM 

00156: 

READ ( I0D9 ,1110)  IPD , UTIL < IP , 1 ) ,PLO ( IP) , PHI (IP) . PAR ( IP, 1 ) , PAR ( IP, 2) 

o 

00157:  1110 
0  0 1  5  8 :  C 

FORMAT \ I5.5F5. 0 ) 

o 

o 

0  0 1 59 : C 

0  0 1  A  0 :  C 

COMPUTE  REMAINING  PARAMETERS 

o 

o 

00161 : 

U  T I L  ( I P ,  2 )  =  2 

o 

00162: 

UTIL ( IP r 3 >  =  4.  -  UTIL ( IP, 1 ) 

o 

00163: 

0  0 1 6  4 :  C 

PAR (IP, 3)  =  PHI (IP) 

o 

o 

0  0 1 6  5 :  C 

0  0 1 6  6 :  C 

LIST  UTILITY  FUNCTION  PARAMETERS  TO  OUTPUT  FILE 

o 

o 

00167: 

URITE (I0D6, 1150)  IP , PLO ( IP ) ,PHI ( IP ) 

0 

00168:  1150 

FORMAT  (/,•'  DECISION  DIMENSION  13 , //,'  LO  HI',/,2F7.2) 

o 

00169: 

URITE  < IOBA , 1 170) 

o 

00170:  1170 

FORMAT ( '  INDEX  UTIL  PAR') 

o 

00171 : 

DO  1800  IV  =1,3 

o 

00172: 

URITE ( I0D6 , 1210)  IV , UT IL ( IP , I V) , PAR ( IP, I V) 

00173:  1210 

FORMAT (I6.2F7.2) 

o 

o 

00174:  1800 

CONTINUE 

00175:  2000 

CONTINUE 

o 

00176: 

RETURN 

o 

00177: 

END 

o 

o 

0 

o 

o 

o 

o 

o 

o 

o 

o 

o 

_o__ 

o 

103 


o 

O 

00178 

SUBROUTINE  BETALU ( IP , 18 ) 

o 

0017? 

c 

• 

O 

00180 

c 

PERFORM  BETA  FUNCTION  CONVOLUTION  FOR  DIMENSION  IP 

o 

00181 

00182 

c 

PARAMETER  MXRULE  =  100,  HXBIM  =  6,  MXBIM2  -  12 

O 

O 

o 

00133 

COMMON  / B L K 0 0 /  NRULE , NHIM 

00184 

COMMON  / B L K 0 2 /  VAL ( MXDIM , 3 ) 

O 

o 

00135 

COMMON  / B L K 0 3 /  UT IL< MXDIM, 3 ) , PAR < HXBIB , 3 ) 

o 

00186 

COMMON  / B L K 0 4 /  BETA (9, 100) , V H 0 B B ( 9 ) 

O 

00187 

COMMON  / B L K 0 8 /  XMIN(MXBIM)  ,XHOD(IIXBIH)  ,XHAX<NXDIH> 

o 

00188 

DENOM  =  XHAX(IP)  -  XMIN(IP) 

0 

00189 

01  =  0.0 

o 

00190 

J1  =  UTIL( IP, 1 ) 

o 

00191 

11  =  INT ( 1 00 .  +  ( PAR ( IP , 1 ) -XMIN ( IP  > ) /DENQM) 

o 

00192 

IF ( 11  .GT.  1005  11  =  100 

o 

00193 

IF ( 1 1  .GE.  1)  01  =  BETA < IB , 1 1 ) 

o 

00194 

VAL(IP.JI)  =  01 

o 

00195 

02  =  0.0 

o 

00196 

•J2  =  U  T I L  ( I P ,  2 ) 

o 

00197 

12  =  INT1 1 00 .*( PAR ( IP . 2 ) -XHIN (IP) ) /DENOM ) 

o 

00199 

IF ( 12  .GT.  100)  12  =  100 

o 

00199 

IF ( 12  .GE.  1 )  02  =  BETA! IB, 12) 

o 

00200 

OAL ( IP, J2)  =  02  -  01 

o 

00201 

J3  =  UTIL(  IF',3) 

o 

00202 

OAL ( IP , J3 )  =  1.  -  02 

o 

00203 

RETURN 

o 

o 

•  00204 

END 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

-O 

o 

o 

o 

o 

o 

o 

104 


o 

o 

o 

00205: 
00206 : 

C 

SUBROUTINE  HISTLUtIP) 

o 

o 

00207: 

00208: 

c 

c 

PERFORM  HISTOGRAM  FUNCTION  CONVOLUTION  FOR  DIMENSION  IP 

o 

o 

00209: 

PARAMETER  MXRULE  =  100,  MXDIM  =  6,  HXDIM2  =  12 

o 

00210: 

COMMON  / B L K 0 0 /  NRULE, NDIM 

o 

0021  1  : 

COMMON  / B L K 0 2 /  UAL ( MXDIM, 3 ) 

0 

00212: 

COMMON  / B L K 0 3 /  UTIL(HXBIH,3),PAR(MXDIM,3) 

o 

00213: 

COMMON  /BLK05/  HI  ST (MXDIM , 21 ) , HDEN (MXDIM, 1 0 ) 

o 

00214: 

COMMON  / B L K 0 6 /  PLO(MXDIM) , PHI < MXDIM ) 

o 

00215: 

SCALE  <  XPAR )  =  (XPAR-PLO ( IP) )/ ( PHI (IP ) -PLO( IP ) ) 

o 

00216: 

NSEG  =  INI (HIST ( IP, 21 ) ) 

o 

00217: 

DO  3000  10  =  1,2 

o 

00218: 

PI  =  SCALE! PARI  IP,  IV ) ) 

o 

o 

00219: 

JI  =  UTIL ( IP , IV ) 

00220: 

VI  =  0. 

o 

o 

00221 : 

DO  2500  IS  =  1 , NSEG 

00222: 

A  =  SCALE  (HIST  ( IP, 2=*=  IS- 1 ) ) 

o 

o 

00223: 

B  =  3  C  A  L  E  ( H I S  T  ( I P ,  2  *  I S ) ) 

00224: 

I F { P I  .LE.  A)  GOTO  2700 

o 

o 

00225: 

IF (PI  .GE.  B)  GOTO  2200 

o 

00226: 

VI  =  VI  +  ( P I - A )  *  HDEN ( IP, IS)  /  ( B - A ) 

0 

00227: 

GOTO  2700 

o 

00228: 

2200 

CONTINUE 

o 

00229: 

VI  =  VI  +  HDEN ( IP , IS ) 

o 

00230: 

2500 

CONTINUE 

o 

00231 : 

2700 

CONTINUE 

o 

00232: 

VAL ( IP ,  JI )  =  VI 

o 

00233: 

3000 

CONTINUE 

o 

00234: 

JI  -  UTIL ( IP , 1 ) 

o 

00235: 

J2  =  U  T I L ( I P , 2 ) 

o 

00236: 

VAL(  IP,  J2)  =  VAL  ( IP,  J2)  -  VALdP.JI) 

o 

00237: 

JI  =  UTIL ( IP. 3) 

o 

o 

00238: 

VAL(IP, JI)  =  1.  -  VI 

00239: 

RETURN 

o 

o 

00240: 

END 

o 

o 

o 

o 

o 

o 

o 

o 

Q 

_ 
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o 


o 


o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 


00241:  SUBROUTINE  INPUTS 

0  0  2  4  2 :  C 

00243:0  INPUT  DISTRIBUTION  FUNCTIONS  FOR  EACH  DIMENSION 
00244:0 

00245:  PARAMETER  MXRULE  =  100,  MXBIM  =  6,  MXDIM2  =  12 

00246:  COMMON  /BLK04/  BETA(9, 100) ,VHGDB(9) 

00247:  COMMON  /BLKOO/  NRULE,NDIM 

00248:  COMMON  /BLK05/  HIST(MXDIM,21 ) ,HBEN(MXBIM,1 0) 

00249:  COMMON  /BLK06/  PLO(MXDIM),PHI(MXDIM) 

00250:  COMMON  / BLK07 /  PDT (MXBIM) , BTYPE ( MXBIM ) ,DSCRT( MXBIM) 

00251:  COMMON  /BLK08/  XMIN(MXBIM) ,XMOD(MXDIM) , XMAX ( HXDIH) 

00252:  COMMON  /BLK99/  I0D5, I0D9, I0B6 

00253:  DO  5000  IP  =  1,NBIM 

00254:  IPP  =  IP 

00255 :  C 

00256 ! C  INPUT  DIMENSION  NUMBER  AND  DISTRIBUTION  TYPE 

00257 : C 

00258:  READ! I0D5, 1010)  IPX , IPDT 

00259:  1010  FORMAT ( 315 ) 

00260:  URITE ( I0D6, 1 110)  IP 

00261  :  1  1  10  FORMAT!//  DECISION  DIMENSION", 13) 

00262:  PDT ( IP)  =  IPDT 

00263:  GO  TO  (2000,  3000,  4000),  IPDT 

00264:  2000  CONTINUE 

00265: C 

()0266:C  INPUT  BETA  DISTRIBUTION  PARAMETERS 
00267 : C 

00268:  REACT  1 0B5 , 2 1 1  0)  IBT , IDD , DA , DB 

00269:  21  10  FORMAT < 215, 2F5 . 0 ) 

00270:  BTYPE(IP)  =  IBT 

00271:  IF( IDD  .NE.  1)  GOTO  2200 

00272:  XMINilP)  =  DA 

00273:  XMAX ( IP)  =  DB 

00274:  GOTO  2500 

00275:  2200  CONTINUE 

00276:  IF < IDD  .NE.  2)  GOTO  2300 

00277:  XMIN(IP)  =  DA 

00278:  XMOD(IP)  =  DB 

00279:  XMAX(IP)  =  XMIN < IP)  -  ! XMOD! IP )-XHIN< IP ) > /OHOBB ( IBT ) 

00280:  GOTO  2500 

00281:  2300  CONTINUE 

00282:  XHOD(IP)  =  DA 

00283:  XMAX ( IP )  =  DB 

00284:  XMIN(IP)  =  (XMOD( IP )-VMODB ( IBT>*XMAX(IP> )/( 1 .  -  VMODB ( IBT) ) 

00285:  2500  CONTINUE 

00286:  U R I T E <  1006,2530)  IBT ,XMIN< IP) ,XMOD( IP) , XMAX ( IP) 

00287:  2530  FORMAT*//  BETA  DISTRIBUTION  TYPE', 13,/, 

00288:  *  '  MIN  MOD  MAX',/,  3F7.2) 


O 


O 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 


r> 


106 


o 

00289 : C 
00290 : C 

PERFORM  BETA  FUNCTION  CONVOLUTION 

O 

o 

00291  :C 
00292: 

CALL  BETALU ( IF'P f IBT ) 

O 

o 

00293: 

GOTO  5000 

O 

00294:  3000 

CONTINUE 

o 

00295 : C 
00296 : C 

INPUT  HISTOGRAM  FUNCTION  PARAMETERS 

O 

o 

00297 : C 
00299:' 

READ ( I0D5 ,31 10)  NSEG 

O 

o 

00299:  3110 

FORMAT (15) 

O 

00300: 

URITE ( I0B6 ,3115)  NSEG 

o 

00301:  3115 
00302: 

FORMAT (/,■"  HISTOGRAM  DISTRIBUTION  WITH ■',13,'  SEGMENTS') 
URITE(I0D6,31 17) 

O 

o 

00303:  3117 

FORMAT (  ■'  SEG  LBB  UBB  BEN") 

O 

00304: 

HIST  ( IF‘,21 )  =  NSEG 

o 

00305: 

DO  3300  IS  =  1 , NSEG 

O 

00306: 

READ (I0U5,31 20)  ISD,HIST'IP,2*IS-1 ) ,HIST ( IP,2*IS ) , H DEN ( IP, IS) 

00307:  3120 

FORMAT ( I5,3F5. 0 ) 

O 

o 

00308: 

WRITE! I0D6,3140)  IS , HIST ( IP , 2*IS-1 ) , HIST ( IP , 2* IS ) ,HDEN (IP ,IS ) 

00309:  3140 

FORMAT ( I5,3F7.2) 

o 

00310:  3300 

CONTINUE 

o 

o 

0031 1 :C 

0031 2: C 

003 1 3 :  C 

PERFORM  HISTOGRAM  DISTRIBUTION  CONVOLUTION 

o 

o 

00314: 

CALL  HISTLU(IPP) 

0 

00315: 

GOTO  5000 

o 

00316:  4000 
0031 7:C 

CONTINUE 

o 

o 

0031 8 : C 

0031 9 : C 

INPUT  DISCRETE  DISTRIBUTION  PARAMETER 

o 

o 

00320: 

READ ( I0D5 ,4110)  DSC 

o 

00321:  4110 

FORMAT (F5.0) 

o 

00322: 

URITE ( I0B6 , 421 0 )  DSC 

0 

00323:  4210 

FORMAT(/, •'  DISCRETE  DISTRIBUTION  AT  ' ,F7.2> 

00324: 

DSCRT ( IP )  =  DSC 

o 

o 

00325: 

HDEN ( IP ,  1 )  =  1. 

00326: 

HIST (IP,21 )  =  1 

o 

o 

00327: 

DELTA  =  (PHI (IP)  -  PLO(IP) )  /  20. 

00328: 

H I S T ( I P , 1 )  =  DSC  -  DELTA 

o 

00329: 

IF ( HIST ( IP, 1 )  .LT.  PLO( IPS )  HIST ( IP, 1 )  =  PLO(IP) 

o 

00330: 

HIST ( IP ,2)  =  DSC  +  DELTA 

o 

00331: 

00332 : C 

IF ( HIST ( IP , 2 )  .GT.  PHI ( IP) )  HIST(IP,2)  =  PHKIP) 

o 

o 

00333:0 

PERFORM  DISCRETE  DISTRIBUTION  CONVOLUTION 

o 

00334:0 

00335: 

CALL  HISTLU(IPP) 

o 

o 

00336:  5000 

CONTINUE 

o 

00337: 

CALL  TABL1 

o 

00338: 

RETURN 

00339: 

END 

o 
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o 


o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 


00340; 

00341  :  C 

00342  :C 

00343  ;C 

00344: 

00345: 

00346: 

00347: 

00348: 

00349: 

00350: 

00351  : 

00352: 


SUBROUTINE  FINDGQ 
COMPUTE  -GO-'  LIKELIHOOD 

PARAMETER  HXRIJLE  =  100,  HXBIH  =  6,  MX DD! 2  =  12 

CHARACTER  S Y H  1 

COMMON  / B L K 0 0 /  NRULE, NDIM 

COHMQN  /BLK01/  SYM ( MXRULE , MXBI M2 ).,  NUM<  HXRIJLE , MX D I M ) 
COMMON  / B L K 0 2 /  UAL ( HXDIH , 3 ) 

COMMON  /BLK09/  TITLE (8) 

COMMON  / B L K 1 0/  PRULE ( MXRULE ) 

COMMON  / B L K 9 9 /  I0B5, 10D9, I0D6 
SUM  =0.0 


00353: 
00354 : 
00355: 
00356: 
00357: 
00358: 
00359: 
00360: 
00361  : 
00362: 
00363: 
00364: 
00365: 
00366: 
00367: 
00368: 


DO  8600  IR  =  1 , NRULE 
PR  =  1.0 

DO  8500  IP  =  1 , N D I M 
SVAL  =  0. 

N1  =  NUM< IR, IP) 

LI  =  I N  T ( N 1 / 3 ) 

L2  =  INTUN1H  )/3) 

IF ( MOD < N 1 ,3)  .EQ.  1 )  L2  =  3 
IF ( MOB (N1 ,3 )  .EQ.  2)  LI  =  1 
DO  8400  IV  =  LI ,L2 
SVAL  =  SVAL  +  VAL ( IP  ,1V) 
8400  CONTINUE 

PR  =  PR  *  SVAL 
3500  CONTINUE 

PRULE (IR)  =  PR 
SUM  =  SUM  +  PR 


00369:  8530  FORMAT ( 215 , 2F7 . 4 ) 

00370:  8600  CONTINUE 

00371:  URITE(IOD6,8610)  ( TITLE! IT),  IT=1,7) 

00372:  861  0  FORMAT ( 1  HI ,  7A4,  / 

00373:  *  •'  LIKELIHOOD  CONTRIBUTION  OF  RULES",  /) 

00374:  URITE(  10116,8630)  ( IR , PRULE ( IR) ,  IR  =  1, NRULE) 

00375:  8630  FORMAT ( 5 ! 15 , F7. 4 ) ) 

00376:  WRITE ( I0B6 ,8710)  SUM .  ( T ITLE ( IT ) ,  I f  =  1 , 7 ) 

00377:  871  0  FORMAT!./, 18H  •'GO"'  LIKELIHOOD  =  ,F7.4/  FOR  ^,7A4) 

00378:  RETURN 

00379:  END 


O 

O 

O 

O 

O 

O 

O 

O 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 


o 


o 


o 


o 


o 


o 
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o 

00380: 

SUBROUTINE  INITL 

O 

O 

o 

00331  : 
00382: 

C 

C 

INITIALIZE  INTERNAL  ARRAYS 

0 

o 

o 

00383: 

00384: 

c 

PARAMETER  MXRULE  =  100,  MXBIM  =  4,  MXDIH2  =  12 

O 

00385: 

COMMON  / B L K 0 0 /  NRULE,NBIM 

o 

00386: 

COMMON  /BLK02/  VAL (MXBIM, 3) 

O 

00387: 

C  0  M  H  0  N  /  B  L  K  0  5  /  •  H I S  T  ( M  X  D I M ,  2 1  ) ,  H  D  E  H  ( M  X  D I H ,  1 0 ) 

o 

00383: 

COMMON  / B L K 0 7 /  PUT  (MXBIM ),  BTYF'E  ( MXBIM ) ,  BSCRT  ( fi X D Til ) 

O 

00389: 

COMMON  / B L K 0 3 /  XHIN(HXBIM) , XMOD ( MXBIM ) , XHAX(NXDIH) 

o 

00390: 

BO  3000  IP  =  1 ,  N  B I M 

O 

00391  : 

PUT (IP)  =  0. 

o 

00392: 

BTYF'E  (IP)  =  0. 

O 

00393: 

BSCRT (IP)  =  0. 

o 

00394: 

XMIN(IP)  =  0. 

O 

00395: 

XMOB(IP)  =  0. 

o 

00396: 

XMAX(IP)  =  0. 

o 

00397: 

BO  2000  IV  =  1.3 

0 

o 

00398: 

VAL (IP.  IV )  =  0. 

o 

00399: 

2000 

CONTINUE 

o 

00400: 

HIST (IF‘,21 )  -  0. 

o 

00401  : 

BO  2700  IS  =  1,10 

0 

00402: 

HIST ( IP , 2 i I S-1 )  =  0. 

o 

00403: 

HIST(IP,2*IS)  =  0. 

o 

00404: 

HBEN ( IP , IS )  =  0, 

o 

00405: 

2700 

CONTINUE 

o 

00406: 

3000 

CONTINUE 

o 

00407: 

RETURN 

0 

00408: 

END 

o 

00409: 

SUBROUTINE  INPUTV 

0 

00410: 

PARAMETER  MXRULE  =  100,  NX DIM  =  6,  HXDIH2  *  12 

o 

0041  1  : 

COMMON  / B L K 0 0 /  NRULE ,NBIM 

0 

00412: 

COMMON  / B L K 0 2 /  VAL (MXBIM, 3) 

o 

o 

00413: 

COMMON  / B L K 9 9 /  I0D5 , 10D9 , 10B6 

00414: 

DO  1  600  IP  =  1  ,'NBIM 

o 

o 

00415: 

READ ( I0B5 ,1410)  IPB,  (VALdP,  IV) ,  IV=1,3) 

00416: 

1410 

FORMAT- 15, 3F5.0) 

0 

o 

00417: 

1600 

CONTINUE 

o 

00418: 

CALL  TABL1 

o 

00419: 

RETURN 

o 

00420: 

END 

0 

o 

o 

o 

o 
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o 

00421  : 

SUBROUTINE  TABU 

O 

O 

o 

o 

00422 :  C 
00423  :C 

LIST  LIKELIHOOD  TABLE 

O 

00424 :  C 
00425: 

PARAMETER  MXRULE  =  100,  MXDIM  =  6 ,  HXBIH2  =  12 

o 

O 

00426: 

COMMON  / B L K 0 0 /  NRULE,NDIH 

o 

00427: 

COMMON  /BLK02/  VAL* MXDIM, 3) 

O 

00428: 

COMMON  / B  L  K  9  9 /  1 0  B  5 , 1 0  D  ? ,  1 0  D  6 

o 

00429: 

URITE ( I0B6  f 1110) 

O 

00430:  1110 

FORMAT  ( / ,  UTILITY  LIKELIHOOD  TABLE') 

o 

00431  : 

WRITE! I0D6, 1210) 

o 

00432:  1210 

FORMAT (  •-  DIM  LOU  MEDIUM  HIGH") 

o 

00433: 

DO  2000  IP  =  1.NDIM 

0 

00434: 

U R I T E ( IQD6, 1410)  IP, (VAL( IP, IV ) f  10  =  1,3) 

o 

00435:  1410 

FORMAT ( 15, 3F9. 4 ) 

o 

00436:  2000 

CONTINUE 

o 

00437: 

RETURN 

o 

00433: 

END 

o 

00439: 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

_o _ 

o 

no 


00440 

00441 

00442 

00443 

00444 

00445 

00446 

00447 

00448 

00449 

00450 

00451 

00452 

00453 

00454 

00455 

00456 

00457 

00458 

00459 

00460 

00461 

00462 

00463 

00464 

00465 

00466 

00467 

00468 

00469 

00470 

00471 

00472 

00473 

00474 

00475 

00476 

00477 

00478 

00479 

00480 

00481 

00482 

00483 


BLOCK  BATA 


DEFINE  CUMULATIVE  (INCOMPLETE)  BETA  FUNCTION  FOR  TYPES  1  TO  9 


COMMON  / B L K 0 4 /  E 
DATA  ( BETA( 1,1), 
*,0.0001 ,0.0003,0 
*,0.0078,0.0097,0 
*,0.0337,0.0379.0 
*,0.0820,0.0889,0 
*,0.1545,0.1640,0 
*,0.2507,0.2628,0 
*,0.3685,0.3828,0 
*,0.5038,0.5197,0 
*,0.6501 ,0.6666,0 
*,0.7973,0.8130,0 
*,0.9286,0.9410,0 

-i.  / 


*  / 

DATA  (BETA (2,1) 
*,0.0004,0.001 1 ,( 
*,0.0227,0.0276 


BETA ( 9 , 1 00) , VMODB ( 9 ) 

,  1=1,100)  /  0.0000 

0.0006,0.001 1 ,0.0017,0 

0.0118,0.0141 ,0.0167,0 

0.0424,0.0472,0.0522,0 

0.0960,0.1035.0.1112,0 

0.1739,0.1840,0.1944,0 

0.2751 ,0.2877,0.3006,0 

0.3973,0.4119,0.4268,0 

0.5357,0.5518,0.5680,0, 

0.6832,0.6997,0.7162,0 

0.8236,0.8439,0.3590,0 

0.9528,0.9637,0.9738,0, 


*, 0.0227,0. 0276, ( 
*,0.0842,0.0934,0 
*,0.1822,0.1950,0 
*,0.3081,0.3234,0 
*,0.4508,0.4672,0 
*,0.5978,0.6138,0 
*,0.7362,0.7505,0 
*,0.8540,0.8653,0 
*,0.9405,0.9479,0 
*,0.9389,0.9918,0 
*  / 

DATA  (BETA'S, I), 
*,0.0096,0.0174,0 
*,0.1121,0.1265,0 
*,0.2513,0.2676,0 
*,0.3996,0.4160,0 
*,0.5431,0.5533,0 
*,0.6732,0.6865,0 
*,0.7841,0.7951  ,0 
*,0.8726,0.8809,0 
*,0.9369,0.9426,0 
*,0.9775,0.9806,0 
*,0.9967,0.9977,0 
*  / 


,  1-1, 
0.0022 
0.0329 
0.1031 
0.2081 
0.3388 
0.4835 
0.6297 
0.7646 
0.8762 
0.9547 
0.9942 


100)  /  0. 
1,0.0037,0 
',0.0388,0 
,0.1132,0 
,0.2216,0 
1,0.3544,0 
1,0.5000,0 
’,0.6455,0 
,,0.7783,0 
1,0.8367,0 
’,0.9611,0 
1,0.9962,0 


0000 

.0057,0 

.0452,0 

.1237,0, 

.2353,0 

.3702,0 

.5164,0 

.6611,0 

.7918,0 

.8963,0, 

.9670,0, 

.9977,0 


0025,0 

0196,0 

0576,0 

1193,0 

2051,0 

3137,0 

4419,0 

5843,0 

7326,0 

8737,0 

9828,0 


,0081  ,0, 
0520,0, 
1346,0. 
2494,0. 
3861,0. 
5327,0. 
6765,0. 
8049,0. 
9065,0. 
9723,0. 
9938,0. 


.0035,0. 

.0227,0. 

.0633,0. 

.1276,0. 

.2161,0. 

.3271,0. 

.4571,0. 

.6006,0. 

.7439,0. 

.8881,0. 

.9906,0. 


0047,0. 
0261 ,0. 
0692,0. 
1363.0. 
2274,0. 
3406,0. 
4725,0. 
6171,0. 
7652,0. 
9021 ,0. 
9967,1. 


,  1  =  1, 
0.0264 
0.1412 
0.2841 
0.4322 
0.5734 
0.6996 
0.8058 
0.3890 
0.9480 
0.9335 
0.9985 


100)  /  0 
,0.0365, 
,0.1563, 
,0.3005, 
,0.4485, 
,0.5883, 
,0.7125, 
,0.8162, 
,0.8967, 
,0.9530, 
,0.9861 , 
,0.9992, 


.0000 

0.0475,0 

0.1716,0 

0.3171,0 

0.4646,0 

0.6030,0 

0.7251,0 

0.8263,0 

0.9042,0 

0.9578,0 

0.9885,0 

0.9996,1, 


0592,0 

1872,0 

3336,0 

4805,0 

6174,0 

7374,0 

8362,0 

9113,0 

9623,0 

9906,0 

0000,1 


.0110.0, 

.0594,0, 

.1460,0. 

.2637,0. 

.4021,0. 

.5491,0. 

.6918,0, 

.8177,0. 

.9157.0. 

.9772,0. 

.9995,0. 

.0716,0. 
.2030,0. 
,3501 ,0. 
.4964,0. 
.6317,0. 
.7495,0. 
.8457,0. 
.9132,0. 
.9665,0. 
.9924,0. 
.0000,1 . 


.0144,0. 
.0672,0. 
.1577,0. 
.2733,0. 
.4183,0. 
.5654,0. 
.7063,0. 
.8302,0. 
.9244,0. 
.9816,0. 
.9999,1 . 


0846,0. 
2189,0. 
3667,0. 
5121,0. 
6457,0, 
7613,0. 
8550,0. 
9247,0. 
9705,0. 
9941 ,0. 
0000,1. 


Ill 
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o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 


00484 

00485 

00486 

00487 

00488 

00489 

00490 

00491 

00492 

00493 

00494 

00495 

00496 

00497 

00498 

00499 

00500 

00501 

00502 

00503 

00504 

00505 

00506 

00507 

00508 

00509 

00510 

0051  1 

00512 

00513 

00514 

00515 

00516 

00517 

00518 

00519 

00520 

00521 

00522 


O 


o 


O 

o 

o 


It  AT  A  <  BETA  ( 4,1),  1  =  1  ,100)  /  0.0000 
*,0.0000,0.0000,0.0000,0.0000,0.0000,0.0001 ,0.0001 ,0.0003,0.0004 
‘*,0.0006,0.0009,0.0012,0.0017,0.0022,0.0028,0.0036,0.0044,0.0055 
*,0.0067,0.0080,0.0096,0.0114,0.0133,0.0156,0.0180,0.0208,0.0238 
*,0.0271,0.0307,0.0347,0.0389,0.0436,0.0486,0.0540,0.0597,0.0659 
*,0.0725,0.0795,0.0870,0.0949,0.1032.0.1121,0.1214,0.1311 ,0.1414 
*,0.1522,0.1634,0.1752,0.1874,0.2002,0.2134,0.2272,0.2414,0.2561 
*,0.2714,0.2871,0.3032,0.3198,0.3369,0.3544,0.3723,0.3906,0.4093 
*,0.4284,0.4477,0.4674,0.4874,0.5077,0.5282,0.5488,0.5697,0.5906 
*,0.6117,0.6328,0.6539,0.6749,0.6958,0.7166,0.7372,0.7576,0.7776 
*,0.7973,0.8165,0.8352,0.8533,0.8708,0.8875,0.9035,0.9185,0.9326 
*,0.9456,0.9575,0.9681,0.9774,0.9853,0.9915,0.9962,0.9990,1.0000 
*  / 

DATA  (BETA(5,I) ,  1=1,100)  /  0.0000 
*,0.0000,0.0000,0.0001 ,0.0002,0.0005,0.0010,0.0016,0.0024,0.0036 
*,0.0050,0.0068,0.0090,0.0116,0.0146,0.0182,0.0223,0.0270,0.0322 
*,0.0381,0.0446,0.0518,0.0597,0.0632,0.0774,0.0874,0.0980,0.1093 
*,0.1214,0.1341,0.1476,0.1617,0.1764,0.1918,0.2078,0.2244,0.2416 
*,0.2593,0.2775,0.2962,0.3153,0.3348,0.3546,0.3748,0.3952,0.4159 
*,0.4367,0.4577,0.4788,0.4999,0.5211,0.5422,0.5632,0.5840,0.6047 
*,0.6251,0.6453,0.6651,0.6846,0.7037,0.7224,0.7406,0.7533,0.7755 
*,0.7921 ,0.8081,0.8235,0.8382,0.8523,0.8658,0.3785,0.3906,0.9019 
*,0.9125,0.9225,0.9317,0.9402,0.9481,0.9553,0.9618,0.9677,0.9729 
*,0.9776,0.9817,0.9853,0.9883,0.9909,0.9931 ,0.9949,0.9963,0.9975 
*,0.9983,0.9989,0.9994,0.9997,0.9998,0.9999,0.9999,0.9999,1.0000 
*  / 

DATA  ( BETA < 6.1),  1  =  1,100)  /  0.0000 
*,0.0038,0.0084,0.0147,0.0226,0.0318,0.0425,0.0543,0.0674,0.0815 
*,0.0965,0.1125,0.1292,0.1467,0.1648,0.1835,0.2027,0.2224,0.2424 
*,0.2627,0.2833,0.3041,0.3251 ,0.3461,0.3672,0.3883,0.4094,0.4303 
*,0.4511 ,0.4718,0.4923,0.5125,0.5325,0.5522,0.5716,0.5907,0.6094 
*,0.6277,0.6456,0.6631 ,0.6802,0.6968.0.7129,0.7286,0.7438.0.7586 
*,0.7728,0.7866,0.7998,0.8126,0.8243,0.8366,0.8478,0.8586,0.8688 
*,0.8786,0.8879,0.8967,0.9051 ,0.9130,0.9205,0.9275,0.9341 ,0.9403 
*,0.9460,0.9514,0.9564,0.9610.0.9653,0.9693,0.9729,0.9762,0.9792 
*,0.9819,0.9844,0.9866,0.9886,0.9904,0.9920,0.9933,0.9945,0.9955 
*,0.9964,0.9972,0.9978,0.9983,0.9988,0.9991,0.9994,0.9996,0.9997 
*,0.9998,0.9999,1.0000,1.0000,1.0000,1.0000,1.0000,1.0000,1.0000 
*  / 


O 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 


112 


o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 


00523: 

00524: 

00525: 

00526: 

00527: 

00528: 

00529: 

00530: 

00531  : 

00532: 

00533: 

00534: 

00535: 

00536: 

00537: 

00538: 

00539: 

00540: 

00541  : 

00542: 

00543: 

00544: 

00545: 

00546: 

00547: 

00548: 

00549: 

00550: 

00551: 

00552: 

00553: 

00554: 

00555: 

00556: 

00557: 

00553: 

00559: 

00560: 

00561  : 

00562: 

00563: 

00564: 

BOTTOM 

%  0 

OK, 


O 


DATA  (BETA (7 , 1 ) ,  1  =  1 , 1 0 0 >  /  0.0000 
*,0.0000,0.0000,0.0000,0.0000,0.0000,0.0000,0.0000,0.0000,0.0000 
*,0.0000,0.0000,0.0001 ,0.0002,0.0003,0.0004,0.0006,0.0008,0.0010 
*,0.0014,0.0018,0.0023,0.0029,0.0036,0.0044,0.0054,0.0066,0.0079 
*,0.0095,0.0112,0.0133,0.0155,0.0181,0.0209,0.0241 ,0.0277,0.0316 
*,0.0360,0.0407,0.0459,0.0516,0.0578,0.0645,0.0718,0.0796,0.0381 
*,0.0971 .0.1068,0.1171 ,0.1231 ,0.1397,0.1521 ,0.1651 ,0.1789,0.1934 
*,0.2086, 0.2245, 0.241 1,0. 2585, 0.2765, 0.2952, 0.31 47, 0.3347, 0.355-4 
*,0.3767,0.3986,0.4210,0.4439,0.4672,0.4909,0.5150,0.5394,0.5639 
*,0.5887,0.6135,0.6333,0.6630,0.6875,0.7118,0.7358,0.7593,0.7822 
*,0.8045,0.8261 ,0.8468,0.8666,0.8853,0.9023,0.9191 ,0.9341 ,0.9476 
*,0.9597,0.9701 ,0.9790,0 .9363,0.991 9,0.9959,0.9935,0. 9997, 1 . 0000 
*  / 

DATA  ( BETA (8,1),  1=1,100)  /  0.0000 
*,0.0000,0.0000,0.0000,0.0000,0.0000,0.0001,0.0003,0.0005,0.0008 
*,0.0013,0.0020,0.0029,0.0041 ,0.0056,0.0074,0.0097,0.0124,0.0157 
*,0.0195,0.0240,0.0291,0.0349,0.0415,0.0488,0.0570,0.0661,0.0761 
*,0.0869,0.0987,0.1114,0.1251 ,0.1397,0.1552,0.1716,0.1889,0.2071 
*,0.2261,0.2459,0.2665,0.2877,0.3096,0.3321,0.3551 ,0.3785,0.4023 
*,0.4265,0.4508,0.4754,0.5000,0.5245,0.5491,0.5734,0.5976,0.6214 
*,0.6448,0.6678,0.6903,0.7122,0.7334,0.7540,0.7733,0.7928,0.8110 
*,0.8283.0.8447,0.8602,0.8748,0.8585,0.9012,0.9130,0.9238,0.9338 
*,0.9429,0.951 1,0.9584,0.9650,0.9703,0.9759,0.9804,0.9842,0.9875 
*,0.9902,0.9925,0.9943,0.9958,0.9970,0.9979,0.9986,0.9991 ,0.9994 
*,0.9996,0.9998,0.9999,0.9999,0.9999,0.9999,0.9999,0.9999,1.0000 
*  / 

DATA  ( BETA ( 9,1),  1=1,100)  /  0.0000 
*,0.0014,0.0040,0.0080,0.0137,0.0209,0.0298,0.0402,0.0523,0.0658 
*,0.0308,0.0971,0.1146,0.1333,0.1531 ,0.1738,0.1954,0.2177,0.2407 
*,0.2642,0.2881 ,0.3124,0.3369,0.3617,0.3865,0.4113,0.4360,0.4606 
*,0.4349,0.5090,0.5327,0.5561 ,0.5789,0.6013,0.6232,0.6445,0.6652 
*,0.6853,0.7047,0.7234,0.7415,0.7588,0.7754,0.7914,0.8066,0.8210 
*,0.8343,0.8479,0.8602,0.3719,0.8823,0.8932,0.9028,0.9119,0.9203 
*,0.9281 ,0.9354, 0.9421, 0.9483, 0.9540, 0.9592, 0.9640, 0.9683,0. 9722 
*,0.9753,0.9790,0.9813,0.9844,0.9367,0.9387,0.9904,0.9920,0.9933 
*,0.9945,0.9955,0.9963,0.9970,0.9976,0.9981,0.9985,0.9989,0.9991 
*,0.9994, 0.9995, 0.9997, 0.9997, 0.9998, 0.9999, 0.9999, 0.9999, 0.9999 
*,1.0000,1 .0000, 1 .0000,1 .0000,1 .0000,1 .0000,1 .0000, 1 .0000,1 .0000 
*  / 

DATA  (VMOBB(I),  1=1,9)  /  0.75,0.50,0.25,0.75,0.50,0.25 
*  ,0.75,0.50,0.25  / 

END 


O 

O 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 
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3.3.2.  Sample  Input  Data  SUMIF5. 


o 

o 

o 

o 

OK,  ED 
EDIT 
$  P  I  00 

.NULL. 
00001  : 

SUM  IF 

1 

5 

O 

O 

O 

O 

00002: 

THREAT  WARNING  /  REACTION  SYSTEM 

00003: 

1 

1 

O 

o 

00004 : 

5 

1 

1.0  3.0 

o 

00005: 

00006: 

2 

1 

9 

O 

o 

00007: 

1 

0.1 

0.3  1.0 

0 

00008: 

3 

1 

0 

00009: 

5 

1 

0.03  0.06 

o 

00010: 

4 

2 

o 

0001  1  : 

4 

o 

00012: 

1 

0.0 

0.2  0.2 

o 

00013: 

9 

0.2 

0.4  0.3 

o 

00014: 

3 

0.4 

0.6  0.4 

o 

00015: 

4 

0.6 

0.8  0.1 

o 

00016: 

C 

9 

o 

o 

00017: 

3 

00018: 

1 

0.0 

0.2  0.2 

o 

o 

00019: 

2 

0.2 

0.4  0.7 

00020: 

3 

0.6 

0.8  0.1 

o 

o 

00021  : 

6 

3 

o 

00022: 

0.71 

o 

00023: 

IR  SUPPRESSOR  -  LOU  RISK 

o 

00024: 

1 

1 

o 

00025: 

7 

1 

1.0  2.5 

o 

00026: 

9 

3 

o 

00027: 

0.18 

o 

00028: 

3 

1 

o 

00029: 

"7 

/ 

1 

.008  .015 

o 

00030: 

4 

2 

o 

00031  : 

3 

o 

00032: 

1 

0.0 

0.2  0.60 

o 

00033: 

2 

0.2 

0.4  0.20 

o 

00034: 

3 

0.4 

0.6  0.20 

o 

00035: 

J 

9 

o 

o 

00036: 

00037: 

1 

0.0 

0.2  0.75 

o 

o 

00038: 

9 

0.4 

0.6  0.25 

00039: 

6 

3 

o 

o 

00040: 

0.40 

o _ 

o 

114 


o 


o 

00041 

;  IR  S U P PRES 

SOR  ~ 

HIGH 

00042 

00043 

1 

7 

/ 

1 

1 

1.0 

2.5 

o 

00044 

9 

3 

o 

00045 

0.6 

00046 

3 

1 

o 

0004? 

/ 

1 

0.03 

0.06 

00043 

4 

9 

o 

o 

0004? 

00050 

3 

1 

0.0 

0.2 

0.2 

00051 

9 

0.2 

0.4 

0.4 

00052 

3 

0.4 

0.6 

0.4 

o 

00053 

5 

o 

00054 

3 

00055 

1 

0.0 

0.2 

.30 

o 

00056 

9 

0.2 

0.4 

.40 

00057 

0.4 

0 . 6 

.30 

o 

00058 

6 

3 

0005? 

BQTTOi 

0.40 

1 

o 

$  (4 

o 

OK, 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 
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3.3.3.  Sample  input  Data  SUMIF9 . 


O 

o 


■0Kf  ED  SIJMIF9 
EDIT 
%  P  100 


o 

.NULL. 
00001  : 

6 

o 

00002: 

69 

00003: 

1 

H+ 

M+ 

H  + 

H* 

L+ 

L+ 

o 

00004: 

9 

L* 

H* 

h  + 

H* 

L  + 

L  + 

00005: 

3 

L* 

ft* 

ft* 

H* 

L  + 

L+ 

0 

00006: 

4 

H* 

ft* 

l* 

H* 

M  + 

L+ 

00007: 

5 

L* 

H* 

ft* 

H* 

ft* 

L  + 

o 

00008: 

6 

M+ 

H+ 

M+ 

ft- 

ft* 

L+ 

00009: 

7 

l* 

H* 

M  + 

ft- 

ft* 

L+ 

o 

00010: 

8 

L* 

ft* 

H* 

ft- 

H* 

L+ 

0001  1  : 

9 

L+ 

ft* 

N* 

ft* 

H* 

L+ 

o 

00012: 

10 

H* 

l* 

H* 

M  + 

H+ 

L+ 

o 

00013: 

1 1 

H+ 

M* 

L* 

H* 

H* 

L+ 

00014: 

12 

ft* 

ft* 

L* 

H* 

H* 

L  + 

o 

00015: 

13 

H* 

L* 

H* 

H* 

H* 

L+ 

00016: 

14 

ft* 

L* 

H* 

ft* 

H* 

L  + 

o 

00017: 

15 

H* 

ft* 

L* 

ft* 

L* 

«■+ 

00018: 

16 

H* 

ft* 

L* 

ft* 

H* 

i'1+ 

o 

00019: 

17 

ft* 

ft* 

L* 

ft* 

ft- 

H  + 

00020: 

13 

H* 

L* 

ft* 

H* 

H- 

M+ 

o 

00021  : 

19 

L* 

ft* 

H* 

H* 

L* 

H+ 

00022: 

20 

ft* 

L* 

H+ 

H* 

ft- 

14  + 

o 

00023: 

21 

h  + 

H* 

M  + 

M* 

H+ 

«•+ 

00024: 

22 

H# 

N* 

H* 

h* 

H* 

i1  + 

o 

00025: 

23 

L* 

H* 

H* 

M+ 

ft* 

H+ 

00026: 

24 

L* 

L* 

H* 

H* 

11  + 

M+ 

o 

00027: 

25 

H* 

M+ 

L* 

H- 

H* 

H+ 

00028: 

26 

h* 

H* 

L* 

ft- 

H* 

lit 

0 

00029: 

27 

H* 

L* 

M+ 

L* 

H* 

H  + 

00030: 

28 

H* 

L# 

ft* 

H* 

H* 

M  + 

o 

00031  : 

29 

L* 

M* 

ft* 

L* 

H* 

H+ 

o 

00032: 

30 

ft* 

L* 

H* 

ft- 

H* 

M+ 

00033: 

31 

H* 

H* 

L* 

ft + 

H* 

H+ 

o 

00034: 

32 

L* 

H* 

L* 

ft* 

H* 

H* 

00035: 

33 

H* 

L* 

ft* 

M  + 

H+ 

«■+ 

o 

00036: 

34 

L* 

L* 

ft* 

ft* 

H* 

M+ 

00037: 

35 

L* 

M  + 

L* 

H* 

H* 

H  + 

o 

00038: 

36 

L* 

L* 

ft* 

H* 

H* 

11  + 

00039: 

37 

1  + 

L* 

L* 

H+ 

H* 

H* 

o 

00040: 

38 

ft* 

ft  + 

H+ 

H- 

L* 

H* 

00041 : 

39 

ft* 

M  + 

ft  + 

l* 

H* 

H* 

o _ 

00042: 

40 

M+ 

ft* 

ft* 

M* 

H* 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 
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o 

00043 

41 

M: 

Mi 

Hi 

Mi 

Mi 

o 

o 

00044 

42 

L= 

=  H* 

M  + 

M- 

Li 

Hi 

o 

00045 

43 

L- 

Hi 

M  + 

Li 

Mi 

Hi 

o 

00046 

44 

L: 

H* 

Mi 

Hi 

Mi 

Hi 

o 

00047 

45 

L: 

Mi 

Hi 

M- 

M- 

Hi 

o 

00043 

46 

M+  H* 

Li 

Mi 

M- 

Hi 

o 

o 

00049 

47 

L*  M* 

Mi 

Mi 

M- 

Hi 

o 

00050 

48 

M+  L* 

Hi 

Mi 

M- 

Hi 

o 

00051 

49 

Mi  M* 

Li 

Hi 

M- 

Hi 

o 

00052 

50 

L*  H* 

Li 

Hi 

M- 

Hi 

o 

00053 

51 

Li  L* 

Hi 

Hi 

Li 

Hi 

o 

00054 

52 

M+  Hi 

Li 

Li 

Mi 

Hi 

o 

00055 

53 

N  + 

L* 

M  + 

Li 

Mi 

Hi 

o 

00056 

54 

M  + 

Li- 

Mi 

Mi 

Mi 

Hi 

o 

00057 

55 

M;t 

Li 

Mi 

Hi 

Mi 

Hi 

o 

00058 

56 

M-f 

Li 

Mi 

Li 

Hi 

Hi 

o 

00059 

57 

Lt 

Mi 

Mi 

Li 

Mi 

Hi 

o 

00060 

58 

L  + 

Mi 

Li 

Mi 

Mi 

Hi 

o 

00061 

59 

L-t 

Hi 

Li 

Mi 

Mi 

Hi 

o 

00062 

60 

Li 

Mi 

Li 

Hi 

Mi 

Hi 

o 

00063 

61 

Li 

Mi 

Li 

Mi 

Hi 

Hi 

o 

00064 

62 

Li 

Li 

Mi 

Mi 

M  + 

Hi 

o 

00065 

63 

L  + 

Li 

Mi 

Hi 

Mi 

Hi 

o 

00066 

64 

u- 

Li 

Hi 

Mi 

Mi 

Hi 

o 

00067 

65 

L  + 

Li 

Li 

Hi 

Mi 

Ht 

o 

o 

00068 

66 

M i 

Mi 

Li 

Li 

Hi 

Hi 

o 

00069 

67 

Li 

Hi 

Li 

Li 

Hi 

Hi 

o 

00070 

68 

L:t 

Li 

Hi 

Li 

Hi 

Hi 

o 

00071 

69 

L  + 

Li 

Li 

Mi 

Hi 

Hi 

o 

00072 

1 

3 

0. 

10 

2  • 

A . 

o 

00073 

n 

3 

0. 

1 

.  0.25 

0.50 

o 

00074 

3 

3 

0. 

1 

.  0.05 

0.10 

o 

00075 

4 

1 

0. 

1 

.  0.20 

0.40 

o 

00076 

5 

1 

0. 

1 

.  0.20 

0.40 

o 

00077 

6 

1 

0. 

1 

.  0.33 

0 .67 

o 

BOTTOM 

o 

o 

0 

o 

o 

o 

o 

o 

o 

o _ 

o 

117 


3.3.4.  Sample  Output  Data  SUMOF6. 


o 

OK,  ED  SUM0F6 

o 

o 

EDIT 
*  P  1000 

o 

o 

.NULL 

„ 

o- 

00001 

1  NUMBER 

OF 

DECISION 

DIMENSIONS 

=  6 

00002 

NUMBER 

OF 

DECESI0N 

HEURISTICS 

=  69 

o 

o 

00003 

00004 

o 

o 

00005 

:  DECISION 

HEURISTICS 

* 

00006 

o 

o 

00007 

1 

Mt 

M+ 

M  + 

H* 

Lt 

L  + 

00008 

2 

L* 

H* 

M  + 

H* 

L  + 

L+ 

o 

00009 

3 

L* 

M* 

H* 

H* 

Lt 

Lt 

0 

00010 

4 

H* 

H* 

L* 

H* 

M  + 

L+ 

o 

00011 

5 

L* 

h* 
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4.0.  USER  INTERFACE  DEVELOPMENTS 


In  Section  3.0  we  described  and  exemplified  the  computer  aids  that  are  now 
available  to  facilitate  trying,  testing,  and  refining  the  SUMMET  decision-aid 
structure.  In  this  section  we  describe  the  Phase  I  work  on  issues  of  "user 
interface" — issues  that  are  important  to  proper  implementation  of  SUMMET  as  a 
computerized,  interactive,  and  user-friendly  decision-aid. 

Human  factors  issues  are  important  considerations  in  the  design  of  any 
man-machine  interface.  Attention  to  these  issues  is  mandatory  in  the  design 
of  a  decision-aid  in  order  to  prevent  the  use  of  the  aid  from  being  more 
difficult  than  making  the  decision  unaided. 

To  design  an  effective  interface  one  must  know  the  characteristics  of  the  user 
population  in  addition  to  how  the  system  will  be  used.  Typically,  such 
information  is  obtained  through  a  detailed  task  analysis.  A  task  analysis  of 
the  decision-making  process  for  the  R&D  funding  of  CM  proposals  is  planned  as 
an  integral  part  of  the  Phase  II  effort. 

In  Phase  I  our  goal  was  to  begin  to  address  the  interface  problem.  Elements 
of  an  ideal  interface  concept  have  been  formulated,  based  on  assumptions  drawn 
from  interviews  with  TACOM  personnel  about  who  would  use  the  SUMMET 
decision-aid  and  the  tasks  that  it  would  perform.  These  assumptions  are: 

o  The  SUMMET  decision-aid  would  have  multiple  users, 
o  The  users  would  be  very  proficient  at  making  funding  decisions,  but 
would  have  varying  levels  of  knowledge  about  computers  and  their  use. 
o  There  is  neither  a  lot  of  time  for,  nor  interest  in,  learning  how  to 
use  a  computer  (e.g.,  a  systems  editor  and  a  file  management  system), 
o  The  system  should  be  "user-friendly." 
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To  best  discuss  how  the  SUMMET-user  interface  can  be  implemented  to 
specifically  address  each  of  these  characteristics,  let  us  first  describe  and 
illustrate  key  elements  of  the  ideal  SUMMET-user  interface  concept  as  we  see 
it. 


4.1.  Summet  Interface  Concept 

A  flow  diagram  of  the  envisioned  SUMMET-user  interface  is  presented  in 
Figure  4-1.  This  diagram  exemplifies  the  logic,  flexibility,  options,  and 
overall  flow  of  control  that  the  interface  will  possess.  The  boxes  (process 
points)  and  diamonds  (decision  points)  represent  abbreviated  versions  of 
actual  frames  that  a  user  would  see.  Much  of  the  detail  about  individual 
frames  is  given  on  the  storyboards  of  Figures  4-2  through  4-30.  In  Figure  4-1 
each  frame  is  numbered  for  identification  purposes  and  for  specifying  the 
branching  options  on  individual  storyboards.  A  word  or  number  sometimes 
appears  on  the  line  connecting  two  frames  (e.g.,  the  word  "RETURN"  between 
Frame  2  and  Frame  3) .  This  represents  the  response  (pressing  the  carriage 
return)  that  the  user  provides  on  Frame  2  to  advance  to  Frame  3.  Where  none 
is  indicated,  RETURN  is  the  appropriate  response.  The  main  functional  areas 
of  the  interface  depicted  in  Figure  4-1  are  the  frames  that  are  multiples  of 
100,  i.e.:  100 — Parameter  Input;  200 — Proposal  Evaluation;  300 — Ordering  and 
Output  Review;  400 — Summary  Table  Review;  500 — Sensitivity  Analysis;  600 — Edit 
Proposal  Descriptions;  700 — Hardcopy;  800 — Continue  Previous  Session;  and 
900 — Exit/End  Session. 

To  depict  the  envisioned  exercise  of  SUMMET  by  a  user,  let  us  step  through  the 
various  functions  highlighted  in  Figure  4-1. 

The  user  first  sees  an  introductory  frame  (Figure  4-2)  followed  by  a  login 
frame  (Figure  4-3) ,  which  also  asks  the  user  to  identify  the  CM  proposals  that 
are  being  considered  for  funding,  if  the  user  wishes  to  continue  a  session 
that  was  begun  earlier,  he  may  branch  to  that  function  (Frame  800,  Figure  4-1) 
from  the  name/proposal  input  frame  (Figure  4-3) . 


128 


I _ 


129 


Figure  4-1.  Proposed  user  Interface  Structure 


PARAMETER  INPUT 

INTRODUCTION 

FRAME 
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Figure  4-1.  Proposed  User  Interface  Structure  (concluded) 


SUMMET  DISPLAY  FRAME  STORYBOARD 


From 


User  Response 


Frame  Number  _ 1 


1.  Text 


SURVIVABILITY  MEASURES  AND  METHODS  EVALUATION  TECHNIQUE 

(SUMMET) 


TACOM/HONEYWELL  INC. 


(Press  RETURN  to  continue) 


2.  Programmer's  Information 

3.  Branching 

Return:  2 

Figure  4-2.  Frame  Number  1 
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SUMMET  DISPLAY  FRAME  STORYBOARD 


From  _ i _ 

User  Response  Return 


Frame  Number 


2 


1.  Text 


PROPOSAL/NAME  INPUT  FRAME 


USERNAME:  (1) 
PASSWORD:  (2) 


Press  CNTRL  CS  to  continue  a  previous  session 

OR 

Enter  the  titles  of  (or  a  mnemonic  for)  the  counter¬ 
measure  proposals  being  considered  for  funding.  Press 
Return  after  each  proposal 

(3) 

Press  Return  to  continue 


2.  Programmer's  Information 


3. 


Print  standard  error  message  for  invalid  log-in  name  or 
password. 


Branching 
Return:  3 
CNTRL  CS: 


800 


Do  not  allow  user  to  continue  until  log-in /password  is  complete. 


(1),  (2),  (3)  are  cursor  positions. 

Store  date,  time,  name,  and  proposal  list  in  a  file  that  can  be 
accessed  to  continue  or  review  a  previous  session. 


Figure  4-3.  Frame  Number  2 
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SUMMET  DISPLAY  FRAME  STORYBOARD 


From  _ _ 2 _ 

User  Response  Return 


Frame  Number  _ 2. 


1.  Text 


COMMAND  LEVEL  MENU 

Please  enter  the  number  of  the  function  you  wish  to  initiate: 

1.  Process  Menu 

2.  Edit  Proposal  List  and  Description 

3.  Hardcopy 

4.  Continue  Previous  Session 

5.  Exit/End  Session 


ENTER  CHOICE  NUMBER  (1) 


2. 


Programmer's  Information 


3 


.  Branching 


(1)  is  cursor  position 

Print  “DATA  ENTRY  ERROR  -  INVALID  CHARACTER 
Please  enter  a  valid  menu  selection” 
for  characters  other  than  1-5 


1.  50 

2.  600 

3.  700 

4.  800 

5.  900 


Figure  4-4.  Frame  Number  3 
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SUMMET  DISPLAY  FRAME  STORYBOARD 

From  3 

User  Response  _1 


Frame  Number  50 


1.  Text 


PROCESS  LEVEL  MENU 

Please  enter  the  number  of  the  process  you  would  like  to  run: 

1.  Characteristic  Parameter  Input 

2.  Send  Proposals  to  be  Evaluated 

3.  Review  Ordering  and  Output 

4.  Review  Parameter  Input  Summary  Table 

5.  Sensitivity  Analysis 


ENTER  CHOICE  NUMBER  (1) 


2.  Programmer's  Information 
(1)  is  cursor  position 

Print:  “DATA  ENTRY  ERROR  -  INVALID  CHARACTER 
Please  enter  valid  menu  selection,”  for  characters 
other  than  1-5. 


3.  Branching 
1.  100 
2.  200 

3.  300 

4.  400 

5.  500 


Figure  4-5.  Frame  Number  50 
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SUMMET  DISPLAY  FRAME  STORYBOARD 


From  _ 50 

User  Response  1 


Frame  Number  100 


1.  Text 


MODE:  Parameter  Input 

(NAME)  ,  you  will  now  begin  the  process  of  inputting  characteristic 
parameter  values  for  each  of  the  six  dimensions:  R&D  Time,  R&D  Risk,  R&D 
Cost,  Performance  Effectiveness,  Combat  Utility,  and  User  Acceptance.  You 
will  do  this  for  each  of  the  (#)  proposals  you  are  currently  considering. 

Press  Return  To  Continue 


2.  Programmer's  Information 

3.  Branching 

(NAME)  is  to  be  the  name  the  user  logged  in  with. 

(#)  is  the  number  of  proposals  in  the  list  of  proposals 
being  considered. 

Return:  101 

Figure  4-6.  Frame  Number  100 
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SUMMET  DISPLAY  FRAME  STORYBOARD 


From  _ 100 

User  Response  Return 


Frame  Number  101 


1.  Text 


MODE:  Parameter  Input 

PROPOSAL  SELECTION  MENU 


Enter  the  number  of  the  proposal  you  wish  to  consider  first: 

1. 

2. 

3. 


N. 


ENTER  CHOICE  NUMBER  (1) 


2.  Programmer's  Information 

3.  Branching 

The  list  of  proposals  is  that  entered  on  frame  and  provided 
the  list  has  not  been  altered  on  Frame  601  or  606. 

No  matter  what  choice 
go  to  102,  but  change 
the  proposal  being 
considered  line  accordingly. 

Print  error  message  from  Frame  50  if  a  valid  number  is  not 
entered. 

(1)  is  cursor  position. 

Figure  4-7.  Frame  Number  101 
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SUMMET  DISPLAY  FRAME  STORYBOARD 


From 


101 


User  Response  Valid  Menu  Selection 


Frame  Number 


102 


1.  Text 

MODE:  Parameter  Input 

PROPOSAL  BEING  CONSIDERED: _ (Proposal  NAME) _ 

Enter  the  number  of  the  dimension  for  which  you  wish  to  input 
parameter  values: 


1. 

R&D  Time 

2. 

R&D  Risk 

3. 

R&D  Cost 

4. 

Performance  Effectiveness 

5. 

Combat  Utility 

6. 

User  Acceptance 

OR 

Enter  the  letter  of  another  proposal  you  wish  to  consider: 

A. 

B. 


N. 


ENTER  CHOICE  NUMBER  (1) 


2. 


Programmer's  Information 


3. 


(NAME)  depends  on  choice  on  Frame  101. 

Letters  “A.  .  .end  of  proposal  list”  contain  the  list  of 
proposals  being  considered. 

(1)  is  cursor  position. 


Branching 
1.  110 
2.  120 

3.  130 

4.  140 

5.  150 

6.  160 


If  letter  is  entered, 
redisplay  same  frame 
with  a  new  name  on 


the  proposal  being 
considered  line. 


Figure  4-8.  Frame  Number  102 
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SUMMET  DISPLAY  FRAME  STORYBOARD 

From  _ !££ 

User  Response  ^ 


Frame  Number  HO 


1.  Text 


MODE:  Parameter  Input 

PROPOSAL  BEING  CONSIDERED:  (Proposal  NAME) _ 

DIMENSION:  R&D  Time 

Please  enter  your  estimate  of  the  R&D  Time  necessary  to  develop  the 
countermeasure  proposal  being  considered  in  terms  of  a  value  or  range 
of  values. 

Current  Value(s) _  New  Value(s)  (1) 

If  you  entered  a  range  of  values,  please  enter  the  modal  value;  if  not, 
press  Return 

Current  Value  _  New  Value  (2) 


2.  Programmer's  Information 


3. 


(NAME)  as  last  entered  on  101  or  102. 

1  and  2  are  cursor  positions. 

Error  message  if  range  is  input  and  Return  given  at  (2). 


Branching 

If  value  for  ( 2)  then 
111,  if  Return  for  (2) 
go  to  102. 


Second  value  must  be  within  range  of  values  specified  in  (1). 


Update  PI  SUMMARY  FRAMES  if  Return  for  (2). 


Update  Current  Value  line. 


Reverse  video  the  R&D  Time  line  of  frame. 

102  if  just  a  value  for  (1). 

Display  appropriate  three  distributions  on  111  if  value  for  (2), 
and  appropriate  ranges. 


Figure  4-9.  Frame  Number  110 
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SUMMET  DISPLAY  FRAME  STORYBOARD 

From  _ 110 


User  Response 


Frame  Number  111 


1.  Text 


MODE:  Parameter  Input 

PROPOSAL  BEING  CONSIDERED:  _ (Proposal  NAME) 

DIMENSION:  R&D  Time 


DISTRIBUTION  SELECTION 

Select  the  most  appropriate  distribution  from  the  three  displayed 
below. 


ENTER  CHOICE  NUMBER 


2.  Programmer's  Information 

3.  Branching 

Valid  Menu:  102 

Input 

(1,2,3) 

Figure  4-10.  Frame  Number  111 
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SUMMET  DISPLAY  FRAME  STORYBOARD 

From  _ 102 

User  Response  2 


Frame  Number  120 


1.  Text 


MODE:  Parameter  Input 

PROPOSAL  BEING  CONSIDERED:  _ (Proposal  NAME) _ 

DIMENSION:  R&D  Risk 

Please  enter  the  technical  outcomes  that  are  trying  to  be 
achieved  in  the  (Proposal  Name)  proposal.  Follow  each 
outcome  with  a  Return. 

(1) 


Press  Return  to  continue 


2.  Programmer's  Information 

3.  Branching 

Use  the  list  that  is  input  as  a  menu  on  the  next  frame  (121). 

Return:  121 

(1)  is  cursor  position.  It  drops  a  line  after  each  Return 
until  Return  occurs  after  nothing  has  been  input. 

Figure  4-11.  Frame  Number  120 
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SUMMET  DISPLAY  FRAME  STORYBOARD 


From  _ 120 


User  Response  Return 


Frame  Number 


121 


1.  Text 

MODE:  Parameter  Input 

PROPOSAL  BEING  CONSIDERED:  _ (Proposal  NAME) 

DIMENSION:  R&D  Risk 


R&D  RISK  OUTCOME  MENU 

Enter  the  number  of  the  outcome  you  wish  to  evaluate 
first: 


1 

2 

N 


ENTER  CHOICE  NUMBER  (1) 


2.  Programmer's  Information  3.  Branching 

These  menu  choices  are  based  on  input  on  Frame  120.  Any  valid  number:  122 

Reverse  video  once  an  outcome  has  been  evaluated. 

Standard  Menu  Error  Message  should  be  ready  for  this  frame. 

(1)  is  cursor  position. 

Update  Outcome  Being  Considered  line  on  next  four  frames. 


Figure  4-12.  Frame  Number  121 
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SUMMET  DISPLAY  FRAME  STORYBOARD 


From  121 

User  Response  Valid  Menu  Selection 

Frame  Number  122 


1.  Text 

MODE:  Parameter  Input 

PROPOSAL  BEING  CONSIDERED:  _ _ (Proposal  NAME) _ 

DIMENSION:  R&D  Risk 

OUTCOME  BEING  CONSIDERED:  _ (Outcome  NAME) _ 

First,  input  the  probability  or  a  range  of  probabilities  for  achieving 
this  particular  outcome: 

Current  Value _  New  Value  (1) 

Then,  if  you  have  input  a  range,  please  indicate  the  modal  probability 
value;  if  not,  press  Return 

Current  Value _  New  Value  (2) 


2.  Programmer's  Information 

3.  Branching 

(1)  and  (2)  are  cursor  positions. 

Valid  Value  for  (2):  123 

If  value  in  (2)  w/i  range  of  values  in  (1),  display  appropriate 
distributions  on  123  with  appropriate  values. 

Return:  124 

Update  PI  Summary  Frames  (551  and  552)  and  Current 

Value  line. 

Reverse  video  appropriate  Menu  line  of  121  if  signal  value 
for  (1). 

Figure  4-13.  Frame  Number  122 
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SUMMET  DISPLAY  FRAME  STORYBOARD 


From  _ 122 

User  Response  Modal  Value  Input 


Frame  Number 


123 


1.  Text 

MODE:  Parameter  Input 

PROPOSAL  BEING  CONSIDERED:  _ (Proposal  NAME) _ 

DIMENSION:  R&D  Risk 

OUTCOME  BEING  CONSIDERED:  _ (Outcome  NAME) _ 

DISTRIBUTION  SELECTION 

Select  the  most  appropriate  distribution  from  the  three  displayed  below: 


ENTER  CHOICE  NUMBER 


2.  Programmer's  Information 
Need  Outcome  name  and  proposal  name. 
Store  distribution  in  PI  Summary  Tables. 


3. 


Branching 

Valid  Menu  Input:  124 
(1,  2,  3) 


Figure  4-14. 


Frame  Number  123 


SUMMET  DISPLAY  FRAME  STORYBOARD 


From  122,  123 

User  Response  Return 


Frame  Number  124 


1.  Text 

MODE:  Parameter  Input 

PROPOSAL  BEING  CONSIDERED: _ (Proposal  NAME) _ 

DIMENSION:  R&D  Risk 

OUTCOME  BEING  CONSIDERED: _ (Outcome  NAME) _ 

Assume  that  the  Outcome  Being  Considered  is  not  attained.  Please 
enter  your  description  of  the  minimally  acceptable  result. 

(1) 

Now  what  is  the  probability  (discrete  or  range)  or  attaining  this  mini¬ 
mally  acceptable  result,  given  that  the  original  Outcome  Being  Considered 
is  not  attained;  i.e.,  P( result  >  min.  acceptable/result  <  Outcome  Being 
Considered). 

Current  Value  _  New  Value  (2^ 

If  you  have  input  a  range,  please  input  the  modal  value;  otherwise, 
press  Return. 

Current  Value  _  New  Value  (3) 


2.  Programmer's  Information 


3. 


Need  to  file  in  Proposal  and  Outcome  names. 
(1),  (2),  (3)  are  cursor  positions. 


Branching 

Valid  Modal  Value: 
Return  at  (3):  121 


125 


Update  PI  Summary  Table. 

Update  and  display  distributions  on  125  if  value  for  (3). 

Reverse  video  (once  outcome  has  been  evaluated)  for  said 
outcome  on  Frame  121. 


Update  Current  Value  line. 


Figure  4-15.  Frame  Number  124 
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SUMMET  DISPLAY  FRAME  STORYBOARD 


From  _ 124 

User  Response  Modal  Value 


Frame  Number  125 

1.  Text 

MODE:  Parameter  Input 

PROPOSAL  BEING  CONSIDERED: _ (Proposal  NAME) _ 

DIMENSION:  R&D  Risk 

OUTCOME  BEING  CONSIDERED: _ (Outcome  NAME) _ 

DISTRIBUTION  SELECTION 

Select  the  most  appropriate  distribution  from  the  three  displayed 
below: 


ENTER  CHOICE  NUMBER 


2. 


Programmer's  Information 


3. 


Need  Proposal  and  Outcome  names. 
Update  PI  Summary  Tables. 


Branching 

Valid  Menu  Selection 
(1,2,3):  121 


Reverse  video  on  121  (after  distribution  has  been  centered 
here)  for  this  outcome. 


Figure  4-16.  Frame  Number  125 


SUMMET  DISPLAY  FRAME  STORYBOARD 

From  _ 102 

User  Response  _JL__ 


Frame  Number 


130 


1.  Text 

MODE:  Parameter  Input 

PROPOSAL  BEING  CONSIDERED: _ (Proposal  NAME) _ 

DIMENSION:  R&D  Cost 

If  you  have  already  entered  TACOM’s  BUDGET  ESTIMATES,  press  Return.  If  not, 
please  enter  the  year  and  an  estimate  (discrete/range)  of  TACOM’s  BUDGET  for 
each  year  that  any  of  the  proposals  being  considered  is  expected  to  cover: 


Year 

TACOM  Budget 

Current  Value _ 

_ New  Value _ 

fhirrpnt,  Valiifi  Npw  Valnp 

If  you  entered  a  range  for  the  budget  estimate,  please  enter  the  modal  value; 
otherwise,  press  Return. 

Current  Value  _  New  Value  (3) 


2.  Programmer's  Information 


3. 


Branching 


Suppress  Proposal  Being  Considered  line. 

Update  PI  Table. 

(1),  (2),  (3)  are  cursor  positions.  After  Return  at  (3) 
go  back  to  (1),  but  one  line  lower. 


Modal  Value:  121 
Return  at  (1)  and  no 
input:  132 


Update  distributions  on  131  if  value  for  (3). 

If  Return  for  Year  and  no  input,  then  go  to  132. 


Figure  4-17.  Frame  Number  130 
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SUMMET  DISPLAY  FRAME  STORYBOARD 


From 


130 


User  Response  Modal  Value 


Frame  Number  131 

1.  Text 

MODE:  Parameter  Input 

PROPOSAL  BEING  CONSIDERED: _ (Proposal  NAME) 

DIMENSION:  R&D  Cost 

DISTRIBUTION  SELECTION 

Select  the  most  appropriate  distribution  from  the  three 
displayed  below: 

ENTER  CHOICE  NUMBER _ 


2.  Programmer's  Information 


3. 


Update  PI  Summary  Tables. 

Suppress  Proposal  Being  Considered  line. 


Branching 

Valid  Menu  Selection 
(1)>  (2),  (3):  130 


Figure  4-18.  Frame  Number  131 
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SUMMET  DISPLAY  FRAME  STORYBOARD 


From  _ 130 

User  Response  Return 

Frame  Number  l3^ 

1.  Text 

MODE:  Parameter  Input 

PROPOSAL  BEING  CONSIDERED: _ (Proposal  NAME) _ 

DIMENSION:  R&D  Cost 

Please  enter  the  R&D  Cost  estimates  for  work  done  in  each  year  the  project 
is  expected  to  run  for: 

_ Year _  _ R&D  Cost  Estimate _ 

Current  Value _ New  Value _  Current  Value _ New  Value _ 

If  you  entered  a  range  for  R&D  cost,  please  enter  the  modal  value;  if  not, 
press  Return. 

Current  Value _  New  Value  (3) 


2.  Programmer's  Information 


3. 


(1),  (2),  (3)  are  cursor  positions. 

Need  proposal  name. 

If  return  for  (3),  go  to  (1),  but  one  line  lower. 
Value  at  (3)  must  be  in  range  specified  in  (2). 


Branching 

Valid  value  at  (3), 
then  133. 

Return  at  (1)  with 
no  input,  then  102, 


Error  Message  if  Return  for  (3)  and  range  at  (2). 


Update  Summary  frames. 


Figure  4-19.  Frame  Number  132 
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SUMMET  DISPLAY  FRAME  STORYBOARD 

From  _ 132 _ 

User  Response  Modal  Value 


Frame  Number  133 


1.  Text 


MODE:  Parameter  Input 

PROPOSAL  BEING  CONSIDERED: _ (Proposal  NAME) 

DIMENSION:  R&D  Cost 


DISTRIBUTION  SELECTION 

Select  the  most  appropriate  distribution  from  the  three  displayed  below: 


ENTER  CHOICE  NUMBER 


2.  Programmer's  Information 
Update  Summary  frames. 


3.  Branching 

Valid  Menu  Selection 
(1),  (2),  (3):  132 


Figure  4-20.  Frame  Number  133 
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SUMMET  DISPLAY  FRAME  STORYBOARD 

From  _ 102 

User  Response  1 


Frame  Number 


140 


1.  Text 

MODE:  Parameter  Input 

PROPOSAL  BEING  CONSIDERED: _ (Proposal  NAME) _ 

DIMENSION:  Performance  Effectiveness 

Using  histogram  results  from  a  one-on-one  engagement  analysis, 
enter  the  frequency  values  for  each  a  pg  interval  below.  Enter 
a  zero  if  there  are  no  occurrences  for  a  given  interval. 


A?s  _i 


.00  - 

.10 

(1) 

.11  - 

.20 

(2) 

.21  - 

.30 

(•) 

.31  - 

.40 

.41  - 

.50 

.51  - 

.60 

.61  - 

.70 

.71  - 

.80 

.81  - 

.90 

.91  - 

1.0 

Press  Return  to  continue 


2.  Programmer's  Information 

3.  Branching 

(1) . (10)  are  cursor  positions. 

Update  PI  Summary  Tables. 

11th  Return:  102 

Figure  4-21.  Frame  Number  140 
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SUMMET  DISPLAY  FRAME  STORYBOARD 


From 


102 


User  Response  _5. 


Frame  Number 


150 


1.  Text 


MODE:  Parameter  Input 

PROPOSAL  BEING  CONSIDERED: _ (Proposal  NAME) _ 

DIMENSION:  Combat  Utility 

Using  histogram  data  obtained  from  force-on-force  analysis,  input 
the  interval  range  for  A  Fc/Fco  and  the  associated  frequency.  Press 
Return  after  each. 


A  Fc/Fco 

f 

(1) 

(2) 

(2) 

(4) 

(5) 

(6) 

(M)  (N) 


2.  Programmer's  Information 


3. 


(1) ...  (N)  are  cursor  positions. 
Update  Summary  Tables. 


Branching 

Return  with  no 
input:  102 


Figure  4-22.  Frame  Number  150 
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SUMMET  DISPLAY  FRAME  STORYBOARD 


From  102 

User  Response  6 


Frame  Number  160 


1.  Text 

MODE:  Parameter  Input 

PROPOSAL  BEING  CONSIDERED: _ (Proposal  NAME) _ 

DIMEN  SION :  User  Acceptance 

Input  an  L,  M,  or  H  for  Low,  Medium,  and  High  utility,  respectively, 
for  each  of  the  user  acceptance  criteria  below: 

ACCEPTANCE  CRITERIA  UTILITY 


User  Need 

(1) 

Time  to  Field 

(2) 

Retrofitability 

(3) 

Tactic  Impact 

(4) 

Useful  Life 

(5) 

Retrofit  Cost 

(6) 

Operation  Cost 

(7) 

Support  Cost 

(8) 

Press  Return  when  all  eight  utilities  have  been  entered. 


2.  Programmer's  Information 


3.  Branching 


(1)...(8)  cursor  positions. 


Return  w/no  input:  102 


Update  PI  Summary  Tables. 


Figure  4-23.  Frame  Number  160 
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SUMMET  DISPLAY  FRAME  STORYBOARD 


From 


50 


User  Response 


2 


Frame  Number 


200 


1.  Text 


MODE:  Send  Proposals  to  be  Rank  Ordered 

The  following  proposals  have  been  ordered  and  evaluated  based  on 
the  characteristic  parameter  values  that  were  input  and  the  stored 
utility  functions  and  heuristics: 


1.  (Prop  name) 

2.  (Prop  name) 

N.  (Prop  name) 
Press  Return  to  get 


back  to  PROCESS  MENU 


2.  Programmer's  Information 

3.  Branching 

If  all  of  the  parameter  values  have  not  been  input, 
then  print  Initial  evaluation  and  ordering  cannot 
be  done  until  the  characteristic  parameter  values 
have  been  entered  for: 

Return :  50 

Press  Return  to  get  back  to  PROCESS  MENU. 

Figure  4-24.  Frame  Number  200 
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SUMMET  DISPLAY  FRAME  STORYBOARD 


From 


50 


User  Response 


3 


Frame  Number 


300 


1.  Text 


MODE:  Review  Ordering  and  Output 


Initial  rank  order  of  “go”  proposals  and  “go”  likelihoods 


1 

2. 

N. 


Rejected  Proposals 


Press  Return  to  get  back  to  PROCESS  MENU 


2.  Programmer's  Information 


3. 


Need  an  error  message  if  this  mode  is  entered 
before  the  proposals  have  been  sent  for 
evaluation. 


Branching 

Return: 


50 


Figure  4-25.  Frame  Number  300 
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SUMMET  DISPLAY  FRAME  STORYBOARD 


From 


50 


User  Response 


Frame  Number  500 


t.  Text 


MODE:  Sensitivity  Analysis 


SENSITIVITY  ANALYSIS  MENU 
Enter  the  number  of  the  function  you  wish  to  perform: 

1.  Edit  the  Characteristic  Parameter  Table  Grouped  by 
Proposal 

2.  Edit  the  Summary  Table  Grouped  by  Dimension 

3.  Send  Proposals  to  be  Re-evaluated  and  Reordered 

4.  Review  Ordering  and  Output 

ENTER  CHOICE  NUMBER  (1) 


2.  Programmer's  Information 

Need  error  message  if  user  attempts  to  enter 
this  mode  before  first  level  analysis  has  been 
done. 

(1)  is  cursor  position. 

Figure  4-26.  Frame  Number  500 


3.  Branching 

1.  551 

2.  552 

3.  553 

4.  554 
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SUMMET  DISPLAY  FRAME  STORYBOARD 

From  500 

User  Response  1 


Frame  Number 


551 


1.  Text 

MODE:  Sensitivity  Analysis 
FUNCTION:  Edit 


Control  F:  Scroll  forward 
Control  B:  Scroll  backward 


CHARACTERISTIC  PARAMETER  TABLE  BY  PROPOSAL 


R&D  Time 


Proposal  NAME 


User  Acceptance 


R&D  Time 


Proposal  NAME 


User  Acceptance 


Press  Return  to  get  back  to  Sensitivity  Analysis  Menu 


2.  Programmer's  Information 

3.  Branching 

Changes  in  data  will  be  made  directly  to  this 
table.  Therefore,  this  table  should  be  linked 
to  the  data  file.  The  initial  parameters  that 
are  sent  to  be  evaluated  should  be  saved, 
however,  and  should  not  be  alterable.  Center 
part  of  screen  should  scroll. 

Return:  500 

Figure  4-27.  Frame  Number  551 
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SUMMET  DISPLAY  FRAME  STORYBOARD 

From  _ 500 

User  Response 


Frame  Number  552 


1.  Text 


MODE:  Sensitivity  Analysis 
FUNCTION:  Edit 


Control  F:  Scroll  forward 
Control  B:  Scroll  backward 


CHARACTERISTIC  PARAMETERS  BY  DIMENSION 


R&D  Time 

Prop  1 
Prop  2 


Prop  N 

Prop  1 
Prop  2 


R&D  Risk 


Prop  N 


Press  Return  to  get  back  to  Sensitivity  Analysis  Menu 


2.  Programmer's  Information 

3.  Branching 

Center  part  of  screen  scrolls. 

Return:  500 

Changes  can  be  made  in  table,  which  should 

then  be  changed  in  the  data  file. 

Original  data  file  should  not  be  changed, 

however. 

Figure  4-28.  Frame  Number  552 
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SUMMET  DISPLAY  FRAME  STORYBOARD 


From 


500 


User  Response  _3 


Frame  Number 


553 


1.  Text 


MODE:  Sensitivity  Analysis 

FUNCTION:  Send  Proposals  to  be  Re-evaluated  and  Ordered 

The  following  proposals  have  been  re-evaluated.  Those  with 
reverse  video  had  changes  made  to  their  initial  parameter 
values: 

1.  — 

2.  - 

N.  -- 

Press  Return  to  get  back  to  Sensitivity  Analysis  Menu 


2.  Programmer's  Information 

3.  Branching 

Compare  buffers  to  allow  for  reverse 
video  feature. 

Return:  500 

Figure  4-29.  Frame  Number  553 
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SUMMET  DISPLAY  FRAME  STORYBOARD 


From 


500 


User  Response 


4 


Frame  Number 


554 


1.  Text 


MODE:  Sensitivity  Analysis 
FUNCTION:  Review  Ordering  and  Output 

NEW  RANK  ORDER  OF  “GO”  PROPOSALS  AND  “GO”  LIKELIHOODS 


1 

2 

N 


REJECTED  PROPOSALS 


1 

2 

N 


Press  Return  to  get  back  to  Sensitivity  Analysis  Menu 


2.  Programmer's  Information 

3.  Branching 

Return:  500 

Figure  4-30.  Frame  Number  554 
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If  this  is  a  new  session,  the  user  continues  to  the  command  level  menu 
(Figure  4-4)  after  entering  the  list  of  proposals  being  considered.  The  main 
working  space  is  accessed  from  the  command  level  menu  by  entering  a  one  (1) . 
That  branches  the  user  to  a  process  level  menu  (Figure  4-5) ,  which  allows 
access  to  parameter  input,  proposal  evaluation,  review,  summary  table  review, 
and  sensitivity  analysis. 

If  the  user  enters  the  parameter  input  mode,  there  is  an  introductory  frame 
(Figure  4-6)  and  a  menu  (Figure  4-7)  that  let  the  user  select  the  proposal  to 
be  evaluated  first.  Frame  102  (Figure  4-8)  asks  the  user  to  select  the 
decision-dimension  that  they  wish  to  input  data  for  first.  This  frame  also 
allows  the  user  to  change  the  CM  proposal  that  data  is  being  entered  for. 

Thus,  he  has  the  capability  to  enter  information  across  proposals  or  across 
the  six  decision-dimensions  (R&D  Time,  R&D  Risk,  r&d  Cost,  performance 
Effectiveness,  Combat  Utility,  User  Acceptance) .  For  R&D  Time  (Figure  4-9) 
the  user  is  asked  to  input  the  estimate  for  development  time  in  terms  of  a 
value  or  range  of  values.  If  a  range  is  input,  the  user  is  asked  to  input  the 
modal  value,  and  then  select  one  of  three  distributions  possessing  different 
amounts  of  variance  (Figure  4-10) .  After  each  dimension  the  user  returns  to 
Frame  102  (Figure  4-8),  to  select  the  next  dimension.  Let's  assume  that  the 
user  proceeds  in  the  order  given. 

For  R&D  Risk  (Figure  4-11) ,  the  user  first  enters  the  outcomes  to  be  achieved 
by  a  particular  proposal;  for  example,  a  95  percent  reduction  in  ir  visibility 
and  a  60  percent  reduction  in  threat  missile  hit  probability. 

Then  he  selects  the  outcome  that  is  to  be  considered  first  (Figure  4-12) .  For 
each  outcome  the  user  enters  the  probability  of  obtaining  that  outcome 
(Figure  4-13) ,  and  the  minimally  acceptable  alternative  and  the  probability  of 
attaining  the  alternative,  given  that  the  original  outcome  is  not  achieved 
(Figure  4-15) .  Both  probabilities  can  be  in  the  form  of  a  range  or  a  discrete 
value.  If  a  range  is  entered,  then  a  distribution  must  be  selected 
(Figures  4-14  and  4-16) . 
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For  R&D  Cost,  a  budget  value  is  entered  for  each  year  that  the  longest  project 
is  expected  to  run  (Figure  4-17) .  Again,  a  range  of  estimates  can  be  entered 
and  the  appropriate  distribution  can  be  picked  for  each  range  entered 
(Figure  4-18) .  Then,  the  user  enters  the  estimated  amount  of  money  the 
project  will  cost  for  each  year  it  runs  (Figure  4-19) ,  and  a  distribution  is 
selected  if  a  range  is  entered  (Figure  4-20) . 

For  Performance  Effectiveness,  the  user  inputs  normalized  histogram  data,  as 

indicated  in  Figure  4-21.  These  data,  generated  for  the  decision  maker  by  a 

one-on-one  engagement  model,  estimate  the  improvement  (Ap  )  in  vehicle 

s 

survival  probability  when  protected  by  the  proposed  CM.  A  similar  input 
procedure  (Figure  4-22)  follows  for  Combat  utility,  except  that  rather  than 
for  Ap g,  the  histogram  input  is  for  the  Af c/fco  parameter,  which  measures 
the  improvement  in  fractional  casualty  ratio  offered  by  the  proposed  CM  and 
estimated  from  force-on-force  analysis. 

Finally,  User  Acceptance  is  handled  by  having  the  user  enter  an  L,  M,  or  H 
(Low,  Medium,  or  High  utility)  for  each  of  the  eight  facets  of  User  Acceptance 
(Figure  4-23) . 

Once  all  of  the  parameters  have  been  entered  for  all  of  the  CM  proposals,  the 
proposals  can  be  evaluated  (Figure  4-24)  and  the  output  can  be  reviewed 
(Figure  4-25) .  If  the  user  wishes  to  make  any  changes  to  the  input  parameters 
to  determine  the  effects  on  the  rank  order,  decision  space  metric,  go/no-go 
decisions,  etc.,  then  the  sensitivity  analysis  mode  (Figure  4-26)  can  be 
accessed.  From  there  the  user  can  edit  changes  to  the  data  files  that  are 
grouped  by  proposal  (Figure  4-27)  or  dimension  (Figure  4-28) .  The  parameters 
can  then  be  re-evaluated  (Figure  4-29)  and  the  analysis  reviewed  (Figure 
4-30) .  The  user  can  return  to  the  command  level  menu  at  any  point  in  the 
program  by  pressing  CONTROL  C.  From  there,  the  user  may  exercise  several 
options.  He  may  wish  to: 
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o  Enter  short  descriptions  of  each  proposal  (Frame  603  of  Figure  4-1) 
to  serve  as  a  reminder  about  various  proposal  details,  should  the 
analysis  need  to  be  stored  and  then  called  up  again  at  a  later  time, 
o  Enter  new  proposals  for  consideration  (Frame  601,  Figure  4-1) . 
o  Change  proposal  names  (Frame  604,  Figure  4-2) . 
o  Change  descriptions  (Frame  605,  Figure  4-2) . 
o  Delete  proposals  from  the  list  (Frame  606,  Figure  4-1) . 

Hardcopy  documentation  can  be  obtained  of  the  initial  parameter  inputs, 
initial  output,  and/or  any  of  the  sensitivity  analysis  parameter  changes  and 
re-ranking  (Frame  700,  Figure  4-1) . 

Finally,  Frames  800  and  900  (Figure  4-1)  allow  the  user  to  continue  or  review 
a  previous  session  or  exit/end  when  finished  with  the  current  session. 

The  user  interface  just  described  will  be  refined  in  Phase  II  of  SUMMET 
development.  This  refinement  will  follow  review  and  critique  with  decision 
makers/aid  users  at  TACOM. 

At  this  point  let  us  critique  the  interface  concept  described  in  terms  of 
aforementioned  user  and  decision-aid  characteristics,  i.e.,  multiple  users, 
expertise  and  knowledge,  time  and  desire  to  learn  computerese,  and 
user-friendliness. 

4.2.  Multiple  Users 

In  addition  to  logging  on  to  the  PRIME  computer,  the  user  also  has  a  log-on 
sequence  for  SUMMET  (see  Figure  4-3) .  This  allows  individuals  to  keep 
separate  files  and  analyses  on  various  proposals,  in  addition,  it  lowers  the 
search  space  for  each  user  who  may  be  looking  for  a  past  run  to  either  revise 
or  review. 
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The  notion  of  multiple  users  implies  another  consideration  —  the  various 
degrees  of  knowledge  and  experience  with  computers. 

4.3.  Varying  Levels  of  Computer  Knowledge 

This  user  variance  poses  a  slightly  more  difficult  interface  problem.  The 
interface  should  not  have  so  much  embedded  help  that  the  experienced  users  are 
forced  to  wade  through  screens  of  material  that  they  are  already  familiar 
with,  nor  should  it  have  so  little  help  that  the  computer  novice  is  lost  as  to 
how  to  proceed. 

To  address  this  user  variability,  the  interface  concept  is  menu-driven,  has 
error  messages  that  provide  guidance,  and  has  an  associated  off-line  manual  to 
provide  help  and  guidance  for  the  optimal  use  of  the  aid.  Menu-driven  systems 
provide  a  good  balance  between  the  varying  levels  of  experience.  They  are 
quick  and  easy  to  learn  and  relatively  quick  to  use.  Figure  4-4  shows  the 
main  command  level  menu  for  the  SUMMET  interface.  From  there  one  can  access 
the  process  menu  (Figure  4-5)  or  any  of  the  other  system  functions,  such  as 
edit  proposal  descriptions,  continue  previous  session,  obtain  hardcopy,  and 
exit/end  session.  The  main  working  space  is  accessed  from  the  process  level 
menu.  From  there  the  user  can  input  the  characteristic  parameter  values,  send 
proposals  off  to  be  reviewed  and  evaluated,  review  ordering  and  output, 
examine  the  parameter  input  summary  tables,  and  carry  out  a  sensitivity 
analysis.  Menus  are  used  elsewhere  for  some  of  the  other  functions  as  well. 
The  main  command  menu  can  be  accessed  from  anywhere  in  the  aid  by  pressing 
CONTROL  C. 

Error  messages  are  designed  to  not  only  flag  the  fact  that  an  error  has  been 
made,  but  also  to  provide  some  guidance  as  to  how  to  correct  the  situation. 

In  Figure  4-4  one  can  see  that  if  a  user  attempts  to  enter  this  mode  before 
all  of  the  characteristic  parameters  have  been  input,  the  system  displays  a 
message  flagging  the  fact  and  directs  the  user  to  get  back  into  parameter 
input  mode  and  finish  entering  values. 
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An  off-line  manual  will  also  be  provided  as  a  further  form  of  help.  The 
manual  will  provide  examples  on  how  to  exercise  the  system,  explain  the  input 
dimensions  and  the  assumptions  behind  them,  and  describe  how  the  aid  is 
actually  using  the  data  that  is  given. 

The  menu  structure,  error  messages  with  guidance,  and  an  off-line  menu  should 
allow  users  of  all  levels  to  learn  to  use  SUMMET  quickly  and  efficiently. 

4.4.  Limited  Time/Desire  to  Learn  the  Computer 


With  a  new  computer  system  or  the  computerization  of  a  formerly  manual 
process,  a  lot  of  front-end  time  can  be  required  to  learn  how  to  use  such 
features  as  the  system  editor  and  the  file  management  system,  in  the  case  of 
the  file  management  system,  we  avoid  the  time  requirement  by  allowing  the  user 
to  store  analyses,  based  on  the  proposal  names  that  are  being  analyzed  and  on 
the  date  and  time  that  the  work  is  being  done.  If  users  wish  to  stop  in  the 
middle  of  a  session,  they  merely  have  to  log  out.  when  they  are  able  to 
continue  later  on,  they  can  enter  the  Continue  Previous  Session  mode  and  find 
the  files  listed  from  most  recently  used  to  oldest.  They  merely  indicate  the 
number  of  the  file  they  wish  to  continue  and  the  computer  uploads  all  of  the 
data  associated  with  that  file. 

The  system  editor  is  usually  the  most  complicated  function  to  use,  with 
different  systems  having  their  own,  often  unique,  set  of  editing  commands. 

The  proposed  interface  allows  the  user  to  change  parameter  inputs  immediately 
after  they  are  made  (by  entering  a  different  input  onto  the  New  value  line)  or 
later  on  in  the  sensitivity  analysis  mode  when  all  of  the  data  is  stored 
together  for  easy  review.  This  process  is  much  simpler  to  use  than  trying  to 
leave  and  remember  a  host  of  system  editor  commands. 
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4.5.  User-Friendliness 


A  user-friendly  system  encompasses  the  following  features: 

o  Easy  to  use/understand 

o  Easy  to  control 

o  Task-oriented 

o  Allows  flexibility  of  task  handling 

o  Tolerates  mistakes 

o  Fulfills  user  expectations 

The  first  four  features  are  handled  by  having  a  menu-driven  system.  Menu 
systems,  as  long  as  the  hierarchy  does  not  become  too  deep,  are  easy  to  use, 
understand,  and  control,  and  are  very  task-oriented.  Figures  4-7,  4-27,  and 
4-28  show  that  data  can  be  input  or  edited  across  decision-dimensions  for  each 
proposal  or  across  proposals  for  each  dimension.  This  feature,  and  the 
ability  to  get  to  the  command  level  menu  from  anywhere  in  the  program,  allow 
for  task  flexibility. 

The  last  feature  may  very  well  be  the  most  important,  in  order  to  fulfill 
user  expectations,  the  system  must  do  what  the  user  expects  it  to  do.  For 
this  to  happen,  the  users  must  become  involved  in  the  development  process  in 
terms  of  both  design  and  implementation  of  the  aid  and  of  the  user  interface. 
In  this  way,  information  is  collected,  analyzed,  and  displayed  in  a  manner 
that  is  both  useful  and  consistent  with  the  user's  expectation.  We  stress 
this  point,  because  user  involvement  will  be  an  integral  part  of  the  Phase  II 
user  interface  definition. 
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